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classified  as  renewal  and  nonrenewal  models.  Wireline  and  most  microwave 
channels  can  be  accurately  represented  by  renewal  models  and  model  parameters 
have  been  chosen  to  represent  practical  AUTOVON  chanr.  Is.  Nonrenewal  models, 
which  are  necessary  to  represent  for  example,  troposc,.tter  channels,  require 
more  statistical  parameters  and  are  not  developed  to  tne  extent  of  renewal 
models . 

Part  II  of  the  report  describes  the  development  and  evaluation  of  an  algorithm 
for  evaluating  error  detecting  codes  for  use  on  renewal  channels.  The  algorithm 
is  sufficiently  efficient  in  its  UBe  of  computer  time  to  permit  an  exhaustive 
study  of  possible  codes  with  a fixed  number  of  redundant  digits. 

The  algorithm  has  been  used  to  rank  all  900  irreducible  16th  degree  polynomials 
with  respect  to  the  Pareto  channel  model. 

For  32  check  bit  codes  with  block  lengths  of  2000  bits,  it  is  shown  that  six 
classes  of  BCH-Fire  codes  encompass  many  of  the  commonly  used  types  of  codes. 
Three  of  these  classes  are  investigated  in  detail  in  a study  that  considered  a 
total  of  approximately  350  polynomials.  There  is  no  evidence  to  indicate 
that  different  results  would  be  obtained  from  a study  of  the  other  three  classes 
of  BCH-Fire  codes. 


From  this  study  it  can  be  concluded  that  a group  of  possibly  a dozen  codes  will 
provide  the  lowest  undetectable  error  probability  in  general  applications  for 
which  a precise  channel  model  cannot  be  specified.  The  estimated  probability  cf 
undetected  errors  for  these  "good"  codes  is  on  the  order  of  10-12,  a value  which 
would  produce  one  undetected  error  in  something  like  fifty  years  at  bit  rates  of 
10°  bits/second.  Four  polynomials  were  found  to  have  undetected  error  prob- 
abilities as  large  as  four  or  more  orders  of  magnitude  greater  than  those  for 
good  polynomials. 


The  code  polynomial,  X32  + X2C'  + X23  + X22  + X16  + X12  + X11  + X10  + X8  + X7  + 
X3  + X^  + X2  + X + 1,  is  recommended  as  specific  choice.  The  characteristics 
of  this  polynomial  are  investigated  in  detail  and  it  is  shown  that  the  poly- 
nomial has  a probabili .y  of  undetected  error  no  larger  than  on  the  order  of 
three  times  that  of  the  best  polynomial  tailored  to  each  specific  channel  model. 
For  four  of  the  channel  models  considered  this  polynomial  is  the  best  of  those 
considered. 


Part  III  of  the  report  details  preliminary  wor ; done  in  extending  the  results  of 
Part  II.  An  elementary  nonrenewal  Chien-Haddad  model  is  studied.  The  sensi- 
tivity of  the  probability  of  undetected  rror  to  the  parameters  of  the  model  and 
differences  between  pattern  probabilities  computed  with  this  model  and  others 
investigated  are  noted. 

A first  step  is  made  in  developing  a channel  model  which  places  In  evidence  the 
effect  of  physical  parameters  such  as  signal-to-noise  ratio.  A channel  model 
for  a DPSK  modem  and  additive  Gaussian  noise  is  developed  which,  surprisingly, 
seems  to  be  almost  identical  to  models  developed  from  practical  data. 

An  approach  to  approximating  nonrenewal  models  with  renewal  models  is  suggested. 
The  report  is  concluded  with  recommendations  for  future  work. 
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The  Post-Doctoral  Program  at  Rone  Air  Development  Cer.te!  is  pursue.:  via 
Pr-  iect  9567  under  the  direction  of  Dr.  K.  W.  Everett,  Jr.  ."he  Post-Doctoral 
Program  is  a cooperative  venture  between  RADC  and  the  participating  universities: 
Syracuse  University  (Department  of  Electrical  and  Computer  Engineering),  the 
U.  S.  Air  Force  Academy  (Department  of  Electrical  Engineering),  Cornell 
University  (School  of  Electrical  Engineering),  Purdue  University  (School  of 
Electrical  Engineering),  University  of  Kentucky  (Department  of  Electrical 
Engineering),  Georgia  Institute  of  Technology  (School  of  Electrical  Engineering), 
Clarkson  College  of  Technology  (Department  of  Electrical  Engineering),  State 
University  of  New  York  at  Buffalo  (Department  of  Electrical  Engineering), 

North  Carolina  State  University  (Department  of  Electrical  Engineering), 

Florida  Technological  University  (U .-par t men t of  Electrical  Engineering), 

Florida  Institute  of  Technology  (College  of  Engineering),  Air  Force  Institute 
of  Technology  (Department  of  Electrical  Engineering),  the  Naval  Postgraduate 
School  (Department  of  Electrical  Engineering),  and  the  University  of  Adelaide 
( Department  of  Electrical  Engineering)  in  South  Australia.  The  Post-Doctoral 
Program  provides,  via  contract,  the  opportunity  for  faculty  and  visiting 
faculty  at  the  participating  universities  to  spend  a year  ’ull  rime  on  explora- 
tory development  and  operational  problem-solving  efforts  with  the  post-Joctorals 
splitting  tneir  time  between  RADC  (or  the  ultimate  customer)  and  the  aducat lonal 
institutions . 

The  Post-Doctoral  Program  is  totally  customer  funded  with  projects  under- 
taken for  Air  Defense  Coinmand  (NORAD),  Air  Force  Communicnl ions  Service, 


Federal  Aviation  Administration,  Defense  Communications  Agency,  Aeron.it t ion i 


Systems  Division  (AFSC),  Air  Force  Aero  Propulsion  Laboratory  (AFSC),  Rome  Air 
Development  Center  (AFSC),  Electronics  System  Division  (AFSC),  NASA,  Air  Force 
Avionics  Laboratory  CAFSC),  and  Air  Force  Weapons  Laboratory  (AFSC). 

This  effort  was  undertaken  for  Defense  Communications  Agency  via  RADC  Job 
Order  9567  0033  with  Dr.  Harry  Heir.:  and  Dr.  Ray  Bittel  as  the  responsible 
individuals  at  DCA-DCEC. 

The  authors  wish  to  acknowl  -Jge  the  assistance  of  Hong  Wah  Li  and 
Robert  Dougan  during  a portion  of  the  study.  The  authors  are  with  Georgia 
Institute  of  Technology:  Joseph  L.  HammonJ,  Jr.,  is  Professor  of  Electrical 

Engineering;  James  E.  Brown  is  Assistant  Professor  Electrical  Engineering 
(now  with  Atlantic  Richfield);  and  Shyan-Shiang  S.  Liu,  Research  Assistant. 


ii 


TABLE  OF  CONTENTS 


Page 


PART  I - INTRODUCTION  AND  BACKGROUND  1 

1.  Introduction  1 

2 Review  of  the  Literature  4 

a.  Channel  Models  4 

b.  Matching  of  Channel  Models  to  Experimental  Data  26 

c.  Prcpert.._s  of  Error  Detecting  Codes  36 

3.  Channel  Moduls  Chosen  for  the  Code  Study  43 

4.  References  47 

PART  II  - CODE  EVALUATION  USING  RENEWAL  CHANNEL  MODELS  49 

1.  Probability  of  Undetectable  Errors  fer  Renewal  49 

Channel  Models 

2.  Approaches  to  Code  Evaluation  52 

3.  Development  of  an  Efficient  Algorithm  for  53 

Code  Evaluation 

4.  Evaluation  of  Z P Algorithm  58 

5.  Results  of  Studief  using  the  Z P,_  Algorithm  61 

6.  Choice  of  a Code  Polynomial  ° 70 

7.  Conclusions  for  Part  II  73 

PART  III  ~ GENERALIZATIONS  75 

1.  The  Chien-Haddad  Renewal  Model:  Results  for  a 75 

Special  Case 

2.  Approaches  to  Developing  Channel  Models  Based  7S 

on  Physical  Parameters 

3.  Approaches  to  the  Approximation  of  Nonrenewal  82 

Models  with  Renewal  Models 

4.  Conclusions  for  Part  III  85 

APPENDIX  I - TYPICAL  CHANNEL  CHARACTERISTICS  88 

APPENDIX  II  - PROGRAM  MAINTENANCE  MANUAL  115 


LIST  OF  MAJOR  SYMBOLS 


P(j)  “ probability  of  an  error  gap  of  length  j 
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a(j)  “ probability  that  the  j th  bit  after  an  error  is  an  error 
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PART  i 


INTRODUCTION  AND  BACKGROUND 

1.  Introduction 

This  study  is  concerned  with  designing  error  detecting  codes  for 
links,  of  the  type  shown  in  Figure  1.1,  such  as  might  be  used  in  future 
digital  Defense  Communications  Systems. 

Since  the  code  must  be  designed  to  match  the  channel,  the  problem 
is  two  fold,  namely:  choosing  realistic  channel  models  and  choosing 

good  codes  for  specified  channel  models.  In  the  most  general  formulation, 
almost  any  channel,  line-of-sight  microwave,  troposcatter , wireline,  or 
satellite,  can  be  of  interest.  The  codes  considered  have  been  restricted 
to  binary  linear  cyclic  block  codes.  The  code  should  have  a large 
block  size-on  the  order  of  200G  bits.  Since  the  number  of  message 
bits  is  not  to  be  fixed,  efficient  truncation  of  the  block  length  should 
be  possible.  The  redundancy  of  the  code  should  be  a multiple  of  8 bit 
bytes  with  a probable  choice  of  four  such  bytes  for  32  bit  redundancy. 
Finally,  scrambling  schemes  such  as  NRZI  should  not  degrade  the  properties 
of  the  code. 

An  extensive  survey  of  the  literature  in  the  two  areas  of  channel 
models  and  error  detecting  codes  has  been  carried  out.  The  survey  reveals 
channel  models  have  been  studied  in  detail  and  a number  of  mathematical 
models  have  been  matched  to  measured  error  data.  The  most  tractable 
model  seems  to  be  the  renewal  model  which  is  specified  by  the  distribution 
function  of  the  error  gaps.  Such  models  are  good  representations  of 
line-of-sight  microwave  and  wireline  channels,  while  their  representation 
for  other  channels  is  much  less  accurate. 
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Other  models,  typically  of  a Markov  typo,  have  boon  used  to 
approximate  various  channels.  The  choice  of  models  to  represent  such 
channels  as  troposcatter  channels  remains  an  open  question,  however, 
for  two  reasons,  namely:  (i)  there  seems  to  be  no  theoretical  analysis  to 

indicate  How  many  moments  of  error  gap  distribution  are  required  to 
determine  code  behavior  and  (it)  the  very  large  amount  of  experimental 
data  required  at  typical  error  rates  hampers  an  extensive  purely 
empirical  approach. 

Given  this  background,  it  was  decided  to  emphasise  in  the  study 
the  renewal  type  channel  models  which  have  been  matched  to  practical 
channels.  Thus  the  major  portion  of  the  contributions  of  the  study  are 
contained  in  Part  II  of  the  report  on  codes  matched  to  renewal  channel 
models. 

Some  preliminary  work  was  done  on  more  general  channel  models,  on 
the  problem  of  developing  chanrcl  models  based  on  physical  parameters 
and  on  the  problem  of  approximating  nonrenewal  models  with  renewal 
models.  This  preliminary  work  is  presented  ir  Parc  ill  of  the  report. 

The  remainder  of  Part  I of  the  report  details  the  review  of  the 
literature.  Appendix  II  provides  a description  of  the  computer  programs 
developed  in  the  study  and  gives  a Program  Maintenance  Manual. 
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2.  Review  of  the  Literature 


The  literature  review  is  presented  in  three  parts,  namely: 
(a)  Channel  Models,  (b)  Matching  of  Models  to  Empirical  Data  and 
(c)  Properties  of  Error  Detecting  Codes. 


(a)  Channel  Models 

In  most  of  the  work  reviewed  for  binary  communication  systems, 
it  was  assumed  that  the  message  source  generates  a sequence  {x^}  of  binary 
digits  which  are  transmitted  through  a channel.  The  channel  output 
sequence  {y^ } is  a binary  sequence  which  is  the  modulo- 2 sum  of  the 
message  sequence  and  an  error  sequence  [e^],  which  is  assumed  to  be 
statistically  independent  of  the  message  sequence.  For  this  structure 
the  statistical  properties  of  the  channel  are  exhibited  in  the 
statistical  properties  of  the  error  sequence. 

A number  of  mathematical  models  are  described  which  provide  differing 
degrees  of  approximation  to  the  measured  output  error  patterns  from 
typical  communication  equipment.  The  most  tractable  mathematical  model 
is  a renewal  model  which  uses  Pareto  statistics.  Most  other  models  are 


Markov  processes  of  some  sort.  A number  of  Markov  processes,  differing 


in  order  and  definition  of  parameters,  have  been  investigated.  The  more 
important  general  models  and  the  references  in  which  they  are  discussed 


are  listed  below: 

General  Model 


References 


* T 


Renewal 

Fritchman 

Gilbert 

Generalized  Gilbert 
Spreading  Markov 
Tsai 

Chien-Raddad 

Pareto 

Munter* 

Blank  and  Trafton* 


Eiiiot  l r 1 3 , [ 2 j 

Fritchman  [3] 

Gilbert  [4] 

Eilfott  [1],  Gal lager  [12] 

At-.il,  et.al.  [5] 

Fritchman  [3],  Tsai  [6]  - [8] 
Chien  et.al.  [9] 

Berger  et.al.  [10],  Sussman  111] 
Munter  et.al.  [13j 
Blank  et.al.  [14] 


+ References  will  be  found  at  the  end  of  Part  I of  this  report. 

* These  models  are  not  strictly  Markov  processes  but  related  to  Markov 
processes . 


Efforts  have  been  made  to  choose  the  parameters  of  the  various 
models  to  match  experimentally  measured  characteristics  of  real  channels. 
The  simplest  models  match  the  first  order  statistics,  of  such  parameters 
as  the  error  gaps  in  experimental  data,  to  corresponding  statistics  of 
the  model.  24ore  sophisticated  models  attempt  to  match  higher  order 
statistics. 

The  models  in  the  above  list  all  represent  attempts  to  match  output 
error  statistics.  Parameters  in  these  models  are  not  related  to  physical 
channel  or  modem  variables.  Although  a considerable  amount  of  work, 
such  as  that  done  by  Bello  [15],  has  been  directed  toward  modeling 
analog  channels  in  terms  of  their  physical  parameters,  this  work  has 
not  been  carried  to  the  point  of  representing  digital  modem  output  error 
statistics.  A step  in  this  direction,  however,  has  been  taken  by 
Goldman  [16  J who  computes  the  probability  of  multiple  errors  for  a 
differential  PSK  modem  for  a channel  represented  by  additive  Gaussian 
noise  and  cochannel  interference. 

Hie  remainder  of  this  section  defines  some  of  the  parameters 
necessary  in  discussing  channel  models  and  then  presents  a concise 
quantitative  discussion  of  mo»t  of  the  models  listed  on  page  4 . 

Basic  Parameters;  A basic  parameter  for  the  present  study  is  the 
probability,  P(m,n),  that  exactly  m bit  errors  occur  in  a transmitted 
block  of  n bits.  The  computation  of  P(m,n)  is  based  on  the  statistical 
analysis  of  the  number  cf  error  free  bits  between  two  bit  errors. 

The  sequence  of  zeroes  (no  errors)  between  the  errors  are  «. ailed  error 
gaps.  The  length  of  a gap  is  defined  as  one  plus  the  total  number  of 
zeroes  in  Che  sequence  between  the  two  ones  (errors).  The  binary  error 
process  can  be  equivalently  described  in  terms  of  the  associated  gap 
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process  j.G^},  where  is  the  length  of  the  ith  gap.  Define 
Pr(Gn  = j}  - p(j)  - P(0j_1  1|1), 


(1.1) 


where  0^  ^ denotes  a sequence  of  j-1  zeroes.  The  error-gap  distribution 


00 

F(m  + 1)  = H p(j) 
j=  m+1 


• p (om|D 


(1.2) 


is  the  probability  of  at  least  m error-free  bits  following  an  error. 

The  parameters  p(j)  and  F(m  + 1)  are  useful  as  well  as  P(m,n). 

The  autocorrelation,  a(j),  is  the  probability  that  the  i th  bit 
following  an  error  is  also  an  error;  i.e. 

a(j)  - S(x*“  1 1/1)  (1.3) 

where  x1  denotes  an  arbitrary  sequence  of  length  i. 

The  term  "error  burst"  plays  a useful  role  in  error  analysis  even 
though  no  generally  accepted  definition  seems  to  exist.  Intuitively 
an  error  burst  is  identified  as  a sequence  beginning  and  ending  with  an 
error  with  relatively  large  gaps  in  either  side  of  it  compared  to  the 
gaps  within  the  burst.  The  notation  B(m,n)  will  be  used  to  designate 
the  probability  of  an  error  burst  of  length  m in  a sequence  of  n bits. 

The  probability  that  m - 1 errors  occur  in  the  n - 1 bits  following 
an  error  is  denoted  R(m,n).  A related  stat-ifttic  of  interest  is  the 
probability  of  m - 1 errors  in  the  n - 1 bits  following  an  error  with  the 
(m  - l)th  error  in  the  (n  - l)st  bit.  The  notation  S(m,n)  will  be  used 
for  this  statistic. 

The  more  important  of  these  basic  parameters  are  evaluated  for  certain 
specific  models  and  are  plotted  in  Appendix  I. 
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Renewal  Channels:  For  a renewal  channel  (lengths  of  gaps  independent) 

the  probability  of  error  patterns  are  easily  computed.  Let 

$(d.,  d_,  ....  d , , ) * S(d)  correspond  to  an  error  pattern  consisting 

of  n consecutive  bits  containing  m errors  where  there  are  d^  zeroes 

before  the  ith  error  and  d^^  zeroes  after  the  last  error.  The  probability 

of  this  pattern  is  expressed  as 


m d . 


pj~g(d)  = P(0  1 1)  • T7  P(0  1 1 1 1)  . P(0  Bri*1  jl) 


= P ( 1) F (d  + 1)  rr  p(d.  -r  1)  F(dnrfi  + 1)  , 

i_2 

Elliot  [2]  proceeds  to  establish 

n-m+1 

P (m , n)  =Z  P(l)  F(j)  R(m,n-j  + 1),  15  ns  £ n, 

j = l 


R(m,n)  = 


n - 1,  n ^ 1 


n-nri-1 

D p(j)  R(m-l,n-j)  2 £ m £ n , n a 2 
j=l 


Alternatively,  for  renewal  channels,  the  autocorrelation,  a(j),  of 
the  bit  errors  can  be  used  to  specify  the  channel.  Elliott  [2]  determines 
a(j)  by  the  recursion 


a(j)  ” ( p(l) 


j-1 

p(j)  + 2 p (s) a( j-s) 
s=l 


j >1 
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The  Binary  Symmetric  Channel  Model:  Ihe  simplest  renewal  channel  is 

the  binary  symmetric  channel.  The  channel  is  a meworyless  channel  with 
the  probability  of  either  type  of  error  being  given  by  q.  It  is 


straightforward  to  establish  that 

P(j)  = qd  - q)j_1  , 

(1.8) 

F(m  + 1)  = (1  - q)m  , 

(1.9) 

and 

/ \ / n m / . v n* m 

p(m,n)  = i , m y q (i  - q) 

(1.10) 

This  channel  is  almost  trivial  to  analyze.  Unfortunately,  it  is  seldom 
applicable  to  a physical  communication  system. 

Pareto  Model  [ lOj : Berger  and  Mandelbrot  proposed  a renewal  model  with 

the  error  gap  distribution  given  by  the  Pareto  distribution 

F(m)  = l/mG,  (1.11) 

where  6 is  a positive  constant  less  than  1.  Since 

X F (m)  = ® , (1.12) 

m 

the  channel  model  does  not  have  finite  recurrence  times;  i.e.  the  average 
number  of  symbols  between  two  errors  is  infinite.  This  problem  is  resolved 
by  letting  6 rake  on  a new  constant  value  greater  than  unity  at  some  value 
m * m . The  value  of  6 for  m < m and  the  value  of  m are  the  parameters 
of  the  model. 

The  more  common  application  of  the  model  is  to  consider  two  truncation 
parameters,  m*  and  m . In  this  study,  the  error  gap  distribution  was 
chosen  to  be  of  the  form 


8 


where 


L = 


1 - a 


a 


(E(n)  + 1) 


1 

1 - a 


and  E(n)  is  the  average  gap  length  given  by 

1-a 


E(n) 


a 


1-a 


1. 


(1.13) 


(1.14) 


(1.15) 


Gilbert  Channel  Model  f 4] ; The  channel  model  proposed  by  Gilbert  consists 
of  a two- state  first-order  Markov  chain  composed  of  a good  state  and 
a bad  state  C^.  The  good  state  is  error  free;  the  bad  state  has  error 
probability  6.  The  state  transitions  occur  synchronously  with  the 
transmission  of  the  input  symbols  according  to  the  state  transition 
probabilities 


(1.16) 


The  process  is  assumed  to  be  stationary. 

The  Gilbert  model  can  be  transformed  into  a three-state  first-order 
Markov  chain  composed  of  two  error-free  states  and  and  an  error 
state  with  the  transition  matrix 


11 

(1-  6)  t12 

6t12 

21 

d-6)t22 

6t22 

21 

(1-  6)  t22 

6t22 

(1.17) 
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A generalization  of  this  channel  model  is  the  Fritchman  model  discussed 
below. 


Fritchman  Channel  Model  f 3l : The  channel  moaul  proposed  by  Fritchman 
consists  of  an  N-state  Markov  chain  whose  state  space  is  partioned  into 
two  groups  of  states.  The  first  K states  are  error-free  and  the  last 
N-K  states  are  error  states.  The  state  transitions  occur  synchronously 
with  the  transmission  of  the  input  symbols  according  to  the  state  transition 
probabilities 


t.  . 
ij 


(1.18) 


The  process  is  assumed  to  be  stationary. 

Tne  error  process  {et}  Is  generated  as  follows:  Partition  the  N 

states  into  the  two  subsets 


A ^ C2,  ...,  Cjj 

and 

B = ick+i’  •••»  S-» 

Let  denote  the  state  process.  Define 


(1.19) 


(1.20) 


r 

0 

* (Ct)  - ( 


l1 

The  process  is  defined  by 


C.  e A 

l 


(L  e B 


et  = 0(zt)  • 


(1.21) 


(1.22) 
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. A 

The  transition  matrix  among  the  A states  is  assumed  to 


be  similar  to  a diagonal  matrix  with 


L(i)  » l<i<K, 


(1.23) 


= (r[x)f  ....  r<x))  , UiSK, 


(1.24) 


corresponding  to  the  left  and  right  eigenvectors  of  T for  the  eigenvalue 

A 

The  m-step  transition  probabilities  may  be  expressed  as 


. , , _ v (k)  . (k)  .m 

t. . (m)  = 2-  a.  r>  7 t)  X, 

k=l  * 1 3 * 


(1.25) 


where 


= Z r<*>  t<k> 
k i-1  1 1 


Fritchman  proceeds  to  establish  that  the  error-gap  distribution  is  given  by 


F(m+1)  = S f (i)  X™ 
i=l  m 1 


(1.26) 


where 


A K 


£ £ 


i=k+i  i=i 


m = 1 


f (i)  - 

m 


j-K+1 


N K K 


(1.27) 


i=K+L  1 m«!  3 11  *• 


m Z.  2 


j=k+l 


The  ^ correspond  to  the  steady-state  probabilities  of  the  channel  states 


c. 

J 
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If  the  transition  matrix  T„  = ^t  ^ among  the  B states  is  assumed 
to  be  similar  to  a diagonal  matrix  with 

1 ^ K+l  <-  i i ti, 

L VVL+l  1 ' 


-(4« 4°)-  K+lsisf;- 


corresponding  to  the  left  and  right  eigenvectors  of  for  the  eigenvalue 
, then  the  error-cluster  distribution  may  be  expressed  as 

'(■»  -i,  «.<»  >r‘ . ■ 


f (i)  = 

m 


K N N 

2-2-2-  r t 

j=l  >j* K+l  m=K-fl  J ^ 

K 

2 m 


a.  = £ r.(k).f (k) 

^ i=Kdl  1 1 


(1.32) 
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Tsai  Channel  Model:  Fritchman  £-*1.3  identifies  a special  case  of  Ins 

general  model  consisting  of  K = N-l  error-free  states  and  a single  error 
state.  This  model,  which  was  later  studied  in  detail  by  Tsai  [63, 
has  a transition  matrix  given  ky 


fcll  0 


N-l, N-l 


CNl  CN2 


Note  that  there  are  no  transitions  between  the  error-free  states.  The 
state  transitions  occur  synchronously  with  the  transmitted  bits. 

It  follow  directly  from  Fritchman’s  model  that  the  error-gap 
distribution  is  given  by 

N-l  , sm-1 

F(m+1)  = Z t k (t kk)  > m S 1.  (] 


The  error-gap  mass  density  function  is  given  by 


P(j)  = F(j)  - F( j+1) 


N-i 

Z t tJ'2  t 

Ti  Nk  kk  kN 


j = 1 


j * 2 
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II 


^^«9SWafMi.r 


E 


Tsai  uses  an  error  burst  defined  by  Brayer  [.24]  as  a sequence: 

1.  beginning  and  ending  with  an  error, 

2.  the  ratio  of  the  number  of  errors  to  the  number  of 
digits  larger  than  or  equal  to  a specified  number  6, 

3.  if  the  inclusion  of  the  next  error  keeps  the  ratio  above 
the  specified  number  6,  the  burst  is  continued;  otherwise 
the  burst  ends,  and 

4.  not  beginning  with  an  error  belonging  to  the  previous 
burst. 

A burst  interval  is  the  region  between  two  bursts.  Obviously,  the  length 
of  an  error  burst  and  the  burst  interval  will  be  affected  by  the  choice 
of  6. 

The  probability  of  a burst  of  length  m with  n errors,  Bn(m),  is 
calculated  as  following:  Let  S(n,m)  be  the  probability  of  a sequence 

of  m digits  with  n errors  satisfying  = 1,  = m,  and 


m. 


6,  1 S i S n , 


where  nu  is  the  length  up  to  the  ith  error.  It  follows  that 

r 


p(m  - 1) 


S(n,m)  = l 


miwj- 


r.  = 2,  m £ 


(1.36) 


fn-l 
6 ’ 
I 

i=n-l 


m 


-1) 

S(n-l,i)  p(m-i) 


n > 2,  2 s m £ 2/6 


where  fractions  are  to  be  taken  as  the  largest  integer  less  than  the 
fraction.  Thus, 


Bn(m)  = S(n,ra)  Prjmn+1  > (n+l)/6j 


U. 37) 
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where  the  fraction  is  to  be  taken  as  the  integer  greater  than  the  fraction. 
Noting  that 


PHr.i  > ( n^- 1 ) / 6^  = Pr^m  . . - nt  > (n+  1)  / 5 - mj 
^ n t i j ^ n-r  l j 


\ 


= Fr  (n+l)/5  - n"1 


(1.38) 


one  concludes 


Bn(Q) 


r 

S(n,m)  F (n+1)  6 - m | , n ;>  2. 


(1.39) 


For  n = 1,  a burst  consists  of  a single  error.  Hence, 


Jjd)  = (n+1)  6 - 1 | , n = 1. 


(1.40') 


The  probability,  B(m),  of  a burst  of  length  m is  given  by 

m 

B (pi)  ~ Y B (m) 
n=m  6 n 

m r 

= Y S(n,m)  Fj  (n+1)  6 ~ 1 : 
n=m6  L 


(1.41) 


since  n/in  s 6 by  definition  of  burst, 
n 

Slowly  Spreading  Markov  Chain  Model  f5l:  This  channel  model  , suggested 

by  Adoul,is  an  extension  of  the  Fritchman  model  to  a denumerably  infinite- 
state  Markov  chain  (slowly  spreading  Markov  chain).  Let  {zn}^  denote  the 
state  process.  The  error  sequence  |en}  is  defined  by 


e = 


n 


z = 0 
n 


z ^ 0 
n 


(1.42) 
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The  state-transition  probabilities  are  given  by 

r 

<4.  j = 0 


t.  . = < p. 

u S 


j = i+l 


otherwise 


(1.43) 


The  state  transitions  are  assumed  to  occur  synchronously  with  the 
transmitted  symbols. 

It  is  obvious  that  for  this  mod'  1 , the  error-gap  distribution  is 
given  by 

m 

F(m  + 1)  = rr  a (1.44) 

k=l  K 

and  the  error-gap  mass  density  function  is  given  by 

j-1 

p(j)  = q.  n p . (1.45) 

J k=l  K 

This  model  allows  a very  general  specification  of  a renewal  process. 

The  only  constraint  is  that  the  error  state  must  be  recurrent;  i.e.  the 
probability  of  eventually  returning  is  unity.  The  return  to  the  error 
state  can  take  a very  large  number  of  transitions.  The  expected  or 
average  number  of  states  for  the  first  return  to  the  error  state  is 

e [g  3 = r j p(j) 
j=i 

CO 

= E j rF(j)  - F(j+l)  j 

j=l  1‘ 


(1.46) 


Hence,  the  specification  is  arbitrary  up  to  the  constraint 


Z F(j)  < ® . 

j=l 

Munter  and  Wolf  Channel  Model  [13]:  The  model  proposed  by  Munter  and 

Wolf  consists  of  combining  M renewal  channels  in  such  a manner  that  the 
resulting  composite  channel  is  not  itself  a renewal  process.  Specifically, 
the  error  bits  occurring  in  a time  interval  n^  + £N,  nQ  + (t  + 1)  N - 1 t 
are  generated  by  a renewal  process  (channel)  CX  with  probability  X^. 

At  time  nQ  + (-L  + 1)  N a new  renewal  process  CL  is  chosen  with  probability 
X.. , independently  of  the  previous  renewal  processes.  The  error  bits 
occurring  in  the  time  interval  nQ  + (t  + 1)  N,  + (1  + 2)  N - lj  are 

generated  by  the  renewal  process  C..  In  general,  a new  renewal  process 
is  selected  every  N samples,  independently  of  the  previous  choices.  The 
starting,  time  nQ  is  equally  likely  to  be  0,  1,  ...,  N - 1. 

The  autocorrelation,  a(j),  of  the  errors  is  given  by 


a(j)  = 


\ h V»  \ 


i M 

,0) 

N l=1  l 


(1.47) 


M 

r X-  p.d) 

i=l 


. 0 S j S!  N, 


where 


a.(j)  = error  autocorrelation  for  C. 
iVJ  i 

and 


P^(l)  = probability  of  bit  error  for  CL  . 

The  derivation  is  based  on  the  assumption  that  at  each  channel  selection 
time,  n + i N , a new  error  sequence  begins  independent  of  the  proceeding. 
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error  sequences;  i.e.  even  if  the  sane  renewal  process  remains  in  effect, 
the  new  error  sequence  is  independent  - f the  previous  one.  This  assumption 
can  be  relaxed  such  that  if  the  same  process  remains  in  effect,  the  new 
error  sequence  is  a continuation  of  the  proceeding  process.  The  resulting 
autocorrelation  is 


M 


x r/  N-  i i i ^ 1 

L X.  p.(l)  ( + T ai(j)  + M X,P,(1)  • 


a(j)  = 


i=l 


n ; i % v 


(1.48) 


, 0 s j S K, 


M 

T,  x,  P.(D 

1 i 


Blank  and  Trafton  Channel  Model  fl4l:  Blank  and  Trafton  consider  a 

generalization  of  Elliott's  renewal  channel  model  for  which  the  error 
process  is  characterized  by  an  n-state  m~th  order  Markov  error-state 
model  with  each  error  state  consisting  of  a renewal  error  process.  The 
state  of  the  channel  is  allowed  to  change  only  when  an  error  occurs. 

The  renewal  processess  are  re-initialized  at  that  time.  The  composite 
channel  is  non-renewal,  in  general.  An  analysis  of  this  model  is  given 
in  the  reference  cited. 

Generalized  Gilbert  Channel  Model,  r 1 1 : The  generalized  Gilbert  channel 

model  consists  of  a two-state  first-order  Markov  chain.  Each  state 

(channel)  is  characterized  as  a binary  symmetric  channel  with  error 

probability  q , i = 1,  2.  The  state  transitions  occur  synchronously  with 

the  transmitted  bits.  The  state  transition  matrix  is  given  by  T 3 t^^  , 

where  t..  denotes  the  probability  of  moving  to  state  C.  from  C.. 
rj  j i 

The  characteristics  of  this  model  may  be  obtained  from  the  analysis 
of  the  Chien-Haddad  model  which  is  a generalization  of  this  model. 
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% 


K 

t 


p 

£ 
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Chien-Haddad  Model  f 9 1 : The  channel  model  proposed  by  Cnien,  et.  al. 

consists  of  an  N state  first-order  Harkov  process.  Corresponding  to 
each  state  C^,  the  channel  is  characterized  by  a binary  summetric  channel 
with  error  probability  q^.  The  state- transition  probabilities  are 
given  by 


t. . 


Pr  ',C.  - C.  ! 
I-  i 


with  the  transitions  occuring  synchronously  with  the  transmitted  symbols. 
The  steady-state  probabilities  ‘jt  j-  are  given  as  the  elements  of  the  vector 
tt  satisfying 


rrT  c rr  . 

To  establish  the  error-gap  distribution  proceed  as  follows: 

Note  that 

F(mfl)  = ?(Onjl) 

= TT  Pr{om,  last  state  C.  | one  in  state  C,1p{c,  jll  q 

^ ^ l v K v 5C  j ' 

_ — L — TT  P |om,  last  state  C jx  in  state  C,  1 rr.  a, 

P(l)  k l r L " * 'k 


49) 


where 


P(l)  = T TT  q 
i=l  1 1 


(1.30) 


Define 


Note  that 


Q (m)  = Pr-,  0m,  last  state  C.  lx  in  state  C,  , . (1.5H 

kt  ^ v ' k*’ 


3k/(m)  = T fckj  (1-9j) 


(1.52) 
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In  matrix  notation 


Q(m)  DQCm  - 1) 


a.  53) 


with  0(0)  1 1,  where 


Qfc!  ” 


>'  - i i - ; u)  i , 


V ***•  %)  ■ 

and  A(q)  corresponds  to  'he  diagonal  matrix  whose  diagonal  elements  are 
the  elements  of  the  vector  q>  Hence, 


Q(m)  = D1 


m 


(1,54) 


and 


,-k-zr.  «4,fa) 

?(D  k=l  1=1  k K «•' 


( • • - 5) 


PU> 


~ A(q)DuleT  , 


where  e”  denotes  the  transpose  of  i.hc  vector 


e - (1,  ....  1) 


In  terms  of  the  eigenvalues  X^  of  D, 


F (m-fl)  = 


P(l)  i=l 


n 

* ti  • . 

1 1 ’ 


Z a,  x: 


where 


(1.56) 


~ l(q)B(i)e'  , 
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= T a.(n)^ 

j*l  J "J 


where 


a (n) 


T a.  . x” 
i 1J  X 

T.  a.  (l-X.)X? 
i 1 11 


The  quantity  P(m,  n)  can  be  computed  for  the  Chien-Hadaad  model 
using  a recursion  relation  which  is  now  given.  The  probability  P(m,  n) 
is  given  by 

P(m,  n)  = Sp  (m,  n) 
i 1 

where  the  sum  extends  over  the  states,  C. , of  the  model  and 

P^(m,  n)  = P{m  errors  in  a block  of  length  n,  last 
bit  is  from  C. }. 

n)  is  then  expressed  as 
N 

= L [Pj  (m  - 1,  n - 1)  t t qj.  + P^  (m,  n-1) 

(1 

hi (1  - V3 

with  the  initial  condition 


The  quantity  P^ (m, 
P.(m,  n) 


P.  (0,  1)  = (1  - q . ) tt. 
J J J 


P.(l,  1)  = q.  r,  , 
J J J 


The  result  can  be  expressed  in  matrix  form  by  defining  a vector  P(m,n) 
as 


P(m,n)  = [?1(m,n),  P2(m,n),  . ..,  P^m.n)] 

(1.62) 

= P(m  - 1,  n - 1)  TA(q)  + P(m,n-1)  T[l  - A(q)] 

The  probability  P(m,n)  is  then  given  by 

P(m,n)  = P(m,n)  e'  (1.63) 

where 

P(0,n)  = rrDn  , n s 0. 

+ 

The  result  for  computing  B(b,  N)  is  given  in  matrix  notation  as 

N-b  . K . . 

B(b,N)  = nE  D R(b)  DW"  e'  (1.64) 

d=0 

where 

R(b)  = TA(q)  Tb_1  A(q) 

B(0,  N)  = tt  dN  e'  . 

A useful  summary  of  the  channel  models  is  given  by  the  state 
transition  diagrams  of  Figure  1.2  for  renewal  models  and  Figure  1.3 
for  nonrenewal  models. 


An  "error  burst"  is  defined  here  as  starting  with  an  error  and  ending 
with  an  error. 
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Gilbert  Model 


Spreading  Markov  Model 


Figure  1.2.  Special  Cases  of  P'  ewal  Models 


Chien-Haddad  Model 


error-free 


error 


Frltchman  Model 


Figure  1.3.  Special  Cases  of  Monrenewal  Models 


Most  of  the  authors  listed  in  the  previous  section  have  made  an 
attempt  to  match  their  channel  models  to  empiracal  data  taken  from  real 
channels.  For  example,  Elliott  [l],  [2],  Gilbert  [4]  and  Munter  and 
Wolf  [13]  work  with  data  for  switched  telephone  networks  such  as  presented 
by  Townsend  and  Watts  [22].  Tsai  [7],  [8],  and  Fritchman  [3]  use  data 
for  HF  channels  and  Chien  et.al.  [9]  and  Tsai  [6]  treat  troposcatter 
channels. 


Possibly  the  most  thorough  study  concerned  with  matching  channel 
models  to  real  channel  data  has  been  conducted  by  Brayer  [23],  [24], 

[25],  [26]  who  considers  HF,  troposcatter,  satellite  and  wireline 
channels.  Extensive  empirical  data  for  troposcatter  channels  is  analyzed 
by  Chien  et.al.  [27j. 

As  a concise  summary  of  the  literature,  it  can  be  stated  that  wireline 
and  HF  channels  have  the  characteristics  of  renewal  models  and  hence 
can  be  modeled  with  good  accuracy.  Troposcatter  channels  are  definitely 
not  renewal  in  nature.  For  these  channels  the  modeling  problem  is 
much  more  complicated  and  the  choice  of  good  models  seems  to  be  still 
an  open  question.  The  remainder  of  this  section  will  discuss  techniques 
for  matching  channel  models  to  experimental  data. 

Renewal  channel  models  have  the  tractable  property  that  a first 
order  statistic  such  as  the  error  gap  distribution,  F(m  + 1),  completely 


defines  the  moael. 


For  many  renewal  channels,  the  model  parameters 


can  be  obtained  by  fitting  the  function 


N-l 

£ 


k-1 
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The  Munter  and  Wolf  model  [13]  effectively  consists  of  M renewal 
channels  ...  C^,  ...  and  hence  represents  a more  complicated 

channel  than  the  rene.->al  one.  If  the  model  is  applied  to  codes  with  fixed 
block  lengths  much  less  then  N,  (recall  that  N determines  the  time  spacing 
of  the  renewal  process),  and  the  component  channels  have  the  same  error 
rate,  the  error  autocorrelation  may  be  approximated  by 

M 

a(j)  I X.  a.-'j)  j « N (1.67) 

i=l  1 1 


for  both  channel  models. 

It  is  also  possible  to  establish  that 


M 

p(j)  « E X.  p.(j)  , j «N  (1.68) 

i=l 


and 

M 

P(m,n)  E X.  P.(m,n)  , m(n-l)  « N , (1.69) 

i=l  1 1 
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where 


P^(j)  = the  error-gap  mass-density  function  for 

and 

P^m.n)  = the  probability  that  exactly  m bit  errors  occur 
in  a transmitted  block  of  n bits  for  C^. 

The  particular  class  of  renewal  channel  used  in  these  formula  will 
depend  upon  the  error  data.  Munter  and  Wolf  [6]  consider  the  Gilbert  [9] 
renewal  channel  model  in  which 


ai<j)  = aL  Kj  + P.  (1)  , j s 1 . 


(1.70) 


Assuming  that 


Pj.(l)  <<;yik!>  1 S j < < N , 


and 


a.  k. 
i l 


1-k.Cl-cy.) 


**  1 . 


it  is  shown  that 


P.(m,n)  = P.(l) 


/n  \ m+1  . n+1 . n- 

v»h  ki 

[l-kjd-a  )]2 


m 


, 1 £ m S n.  (1.71) 


The  application  of  this  model  to  actual  data  consists  of  the 
following  steps: 


There  is  a possible  inconsistency  in  (1.69)  and  (1.71).  See  Appendix  III 
for  a discussion  of  this  point. 
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1.  Plot  the  experimentally  measured  error  data  P(m,n)/^  as  a 
function  of  m for  various  values  of  n. 

2.  Approximate  each  curve  by  straightline  segments  parallel  to 
one  another  for  different  values  of  n. 

3.  From  the  theoretical  model,  one  has 

nri-1  ,,n+l  ,n-u 

ai  K< 

[1  - K^l-c.)]2 

Let  P^(l)  be  the  average  error  rate  of  the  data.  The  ith  set  of  straightline 
approximations  are  matched  to  the  ith  term  in  the  summation.  The  slope  of 
the  ith  approximation  is 

r 1 

log  ; 

the  vertical  separation  between  the  iJLh  approximations  resulting  from 
changing  n by  A n is 

An  log  j_Ki(l-cri) j ; 

and  the  vertical  positioning  of  the  ith  segments  is  specified  by  \ 

The  Chien-Haddad  model,  which  is  one  of  the  mos:  general  reviewed 
in  this  report,  requires  both  first  and  second  order  statistics  of  the 
error  process.  Consider  the  problem  of  determining  the  model  based  on 
knowledge  of  P(l),  F(m+1),  and  F(m+1;  n+1)  as  defined  in  (1.58). 

Restrict  attention  to  the  case  for  which  D is  similar  to  a diagonal 
matrix;  i.e. 

D = MAOOM"1.  (1.72) 
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Note  that 


[I  - zD]'1  * H[l  - zA(X)]"1  M"1 


= .2.  r u.  (l-\.  z)  * , 
i=i  11  1 * 


M - h : r2 : •" : rN  j • 


is  the  right  eigenvector  of  D corresponding  to  \ , 


ik  is  the  left  eigenvector  of  D corresponding  to  , 


vj  - 


B(i)  = r'  u. 

ii 


For  convenience,  normalize  the  eigenvectors  frH  such  that 


N 

*■* 

Lj 

1=1 


r = 
* i 


a. 75) 


Note  that 


= M'W  = M 


-1 


One,  therefore,  lias 


F(nH-l) 


_1_  N m 

pen  Vi 


(1.76) 


where 


^ = nA(q)  r!^  . 
Define  the  vector 


® (®^»  •••»  3^)  « 


(1.77) 


Note  that 


a = rrA(q)M 
= 7TTA(q)M 

= tt[T  - MA(X)M'1]M 
= ttM  - nMA(X)  . 


tThe  fact  that  this  can  be  done  is  based  on  observing  that  the  eigen- 


vectors may  be  expressed  as 

constant.  Hence,  Me'  = 

= § d.el . Therefore, 

i=l  1 1 


r!  = c.e’. , where  e.e!  = 1 and  c.  is  an  arbitrary 
lii  ii  i 

c^el.  Moreover,  the  el  forms  a basis.  Hence 
choosing  c^d^^  results  in  the  appropriate  normalization. 


-U 


e 


Similarly,  for  the  joint  error-gap  distribution  one  obtains 
a « n & (q)  r'  ul  T &(  :)r.' 

= 2i  uiTA(<I>r]  • 

Define  the  matrix 

A = {a..} 

= A(?->  I-f 1 TA(q)M 

Observing  that 

T - D[I  - A(q)]_1 

= MA(X)M_1  [I  - A(q)]"1 
enables  one  to  express 

A = A(a)  A( X)M" 1 [I  - A(q)]_i  A(q)K 

= A(a)  A(X)M_1  [I  - A(q)]'1  M - A(a)  A(X) 
= A(a)  B - A(a)  A(X)  , 

where 

B = A(X)  if1  [I  - A(q)]'1  M . 


(1.78) 


(1.79) 


(1.80) 
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Note  that 


i K 3 = tt  T M 


^ TT  M 


and 


Be’  = A(X)  H'3  [I  - Mq) j_1 


= M-1  MA(X)M-1  [1  - A(q)]"1  e' 


T e‘ 


e! 


= e 


i 


(1.811 


These  two  relations  are  essentially  constraint  relations  placed  on  the 
choice  of  M and  B since  they  do  not  depend  on  the  data.  It  is  seen  from 
above  that 


. i 


A(X)M  * [I  - A(q)]”1  e'  = e! 


or,  equivalently. 


[I  - A(q)]"1  e*  - M[6(X) j"1  e’  ; 


(1.82) 


i.e. 


1_ 

1 ' ^i 


N 

£ Vxj 

j * 


( i . S ;) 


Therefore , ilu*  steps  involved  in  identifying  the  model  .•ire. 


K . 

1)  Measure  P (1 ) = £ n.q. 

i=l  1 1 


1 rr 

2)  Measure  F(m+1)  = £ a.X.‘  or,  equivalent ly, 

P(l)  i i 


measure  P(Oml)  = E a.X?  . Fron  these  measurements 
i=l  1 1 


determine  fa.}  and  < } . } . 
- l ' 


. N N 

3)  Measure  F(m+1;  n+1)  = . E E a.  .X?}.1? 

PU)  i.-,  J=1  u i j 


for  a set  of  at  least  N(N-l)  different  values  of 
m and  n and  use  the  constraint  relation  Be*  = e’ 
to  obtain  a set  of  linear  equations  for  B (or  A). 


4)  Obtain  the  model  matrix  M and  the  vector  q from 
ILO.)  j*1  B = M"1  [I  - A(q)]" 1 M 


and 


Me1  = e’  . 


N 

5)  Obtain  the  vector  tt  from  P(l)  = E TT-<5-  • 

i=l  1 1 


Note  that  Step  3 may  be  replaced  by  measuring 


N 

F (m+1  | n+1)  = E a.CnjX1? 

j=l  3 3 


(1.84) 
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for  at  least  N-l  values  of  n to  determine  the  values  of 


a(n)  = (a^n),  a^n)) 


er,4cm"  A 


eA(a)[l-  A(X)]  [A(X)]n  e' 


for  n = n^,  n£,  n^,  Solve  for  A using  the  constraint  Be'  - e' 

Another  useful  substitution  for  Step  3 is  to  measure 


n 


F(nri-1  | n^  s n s n.+^) 


J+l  r 

T.  F(m+1;  n+1)  LF(n.+l)  - F(n. , ,+D"1 

j i+1 

n=n . J 

J 


= ^ ai(nj»  nj+l)  Xi  ’ 


(1.85) 


where 


a . ; n . , j , .1  = 
i\  j n+1/ 


V* 

L 

n=n . 
J 


ria,.in 
u u k 


. Y1 


n=n . 


-f  £(>.)  j A 


sM«){[4(»]°j  - [6(X)]”i+l} 


(1.86) 


The  procedure  for  using  this  approach  is  the  same  as  in  Step  3. 


A number  of  texts  such  as  Peterson  [17]  and  Liu  [18]  discuss  basic 
properties  of  error  detecting  codes.  However,  the  main  thrust  of  these 
texts,  and,  in  fact,  of  recent  work  in  coding  theory,  seems  to  be  the  study 
of  error  correcting,  rather  than  error  detecting,  codes.  Although 
tractable  relations  between  the  error  detecting  and  error  correcting 
properties  of  codes  are  weli  known,  a good  error  correcting  code  is 
not  necessarily  a good  error  detecting  code. 

Only  a few  papers  devoted  to  error  detecting  codes,  such  as  those 
by  Corr  [19]  and  by  Peterson  [20],  were  found  in  the  review  of  the 
literature.  Whereas  synthesis  procedures  were  found  for  error  correcting 
codes,  none  could  be  found  for  error  detecting  codes. 

This  section  of  the  report  summarizes  material  from  the  literature, 
(principally  Peterson  [17 ] and  j.iu  [18]),  pertaining  to  basic  properties 
of  error  detecting  codes  which  are  germane  to  the  remainder  of  the  study. 
Attention  is  restricted  to  linear,  binary,  cyclic,  block  codes. 

In  the  present  context  an  encoder  maps  a sequence  of  binary  message 
digits  into  a sequence  of  binary  code  digits.  The  message  and  its  code 
word  image  both  have  fixed  lengths  for  the  type  of  codes  being  considered 
and  hence  they  can  be  regarded  as  sectors.  Consider  a message  vector 
of  k digits.  A code  vector  of  n digits  is  formed  to  correspond  to  each 
message  vector.  The  code  vector  can  be  constructed  in  a "systematic 
form"  consisting  of  the  k message  digits  preceeded  (or  followed)  by  n - k 
redundant  digits.  The  problem  of  code  design  amounts  to  finding  an 
algorithm  for  choosing  the  n - k redundant  digits  in  the  code  vector  so 
that  error  detection,  or  error  correction,  is  carried  out  with  the 
smallest  possible  probability  of  error. 
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In  the  study  of  linear  binary  cyclic  codes  it  is  convenient  to  treat 
the  components  of  code  and  message  vectors  as  coefficients  of  a polynomial. 
This  results  in  a one-to-one  correspondence  between,  for  example,  a 
code  vector  v and  a code  polynomial  V(X)  as  given  by 

v “ <v0’  vl»  **•»  vn-l^  ° V(X)  * vo  + vi  x + **'  + vn-l  X°  1 d-87) 

A similar  correspondence  is  set  up  for  message  vectors.  Using  this 
artifice,  it  is  possible  to  investigate  the  structure  of  codes  through  a 
study  of  appropriate  binary  polynomials. 

Some  of  the  more  important  properties  of  codes,  with  respect  to  the 
present  study,  will  be  summarized  below  in  terms  of  these  binary  polynomials. 
Proofs  of  the  properties  will  be  found  in  the  references,  particularly 
[18]  and  [20]. 

Every  code  polynomial  V(X)  in  a (n,  k)  cyclic  code  can  be  expressed 
as 


V(X)  = M(X)  g(X ) (1.88) 

where 

M(X)  = mQ  + mx  X + ...  + m^  Xk_1  (1.89) 

can  be  the  message  polynomial  and 

g(X)  - 1 + &1  X + g2  X2  + ...  + gn_k_1  Xm'k_l  +xr,'k  (1.90) 

is  termed  a "code  generator"  polynomial. 

In  a (n,  k)  cyclic  code  there  exists  one  and  only  one  generator 
polynomial,  g(y),of  degree  n - k.  (The  degree  of  a polynomial  is  the 
largest  power  of  X it  a term  with  a nonzero  coefficient.)  Every  code 
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polynomial,  V(X) , is  a multiple  of  g(X)  and  every  polynomial  of  degree 
r - 1 or  less  which  is  a multiple  of  gfX)  must  be  a code  polynomial  - 
fherefore  the  code  is  completely  specified  by  the  generator  polynomial, 
g(X). 

If  a(X),  b(X)  and  c(X)  are  polynomials  and 


a (a)  b(x)  = c(X) , 

then  a(X)  and  b(X)  are  said  to  be  "factors"  of  c(X)  or  c(X)  is  divisible 
by  a(x)  and  b(x).  A polynomial  p(X)  of  degree  n greater  than  0 which  is 
not  divisible  by  any  polynomial  of  degree  less  than  n is  called 
"irreducible . " 

The  generator  polynomial  of  a (n,  k)  cyclic  code  is  a factor  of 
Xn  + 1 , i . e . 

X°  + 1 = g(X)  h(X).  (1.91) 


Conversely,  if  g(X)  is  a polynomial  of  degree  n - k and  is  a factor  of 

X°  + 1 , then  it  generates  a (n,  kt  cyclic  code. 

An  irreducible  binary  polynomial  of  degree  m is  "primitive"  if  and 

only  if  it  devides  Xn  + 1 for  n no  less  than  2m  - 1.  Thus  a primitive 

polynomial  of  degree  n - k will  divide  xn  + 1 for  n no  less  than  2°  K-  1 

n “k 

and  hence  generates  a code  of  length  at  least  2 -1.  A code  generated  by 

a primitive  polynomial  is  called  a Hamming  code. 

The  class,  fV],  of  code  vectors  for  a binary,  cyclic  (n,  k)  code 
generated  by  g(X)  has  the  properties: 


i . 
i i . 
iii. 


‘V]  contains  the  zero  vector 

'.V}  contains  the  sum  of  any  two  vectors  in  ^V) 
if  = (Vq,  ....  v^)  is  in  [v]  then  so  is 

V2  = ^vn-  L ' — ’ v0’  — ’ Vn-  -t-  p t or  * ~ l* 


2 


n. 
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Code  vectors  can  be  expressed  in  the  systematic  form 


V(X)  - R(X1  + Xn"k  M(X) . 


Since,  V(X)  * g(X)  Q(X),  (1.92)  can  be  written  as 


g(X)  Q(X)  = R(X)  + Xn_k  M(X) 


showing  that  R(X)  can  be  constructed  as  the  remainder  resulting  from  the 
division  of  X M(X)  by  g(X).  Note  that  the  vector  corresponding  to 
the  polynomial  of  (1.92)  is 


V(X)  ° v (vq,  vl*  •••  Vn-k-l * m0*  ml*  ***  mic_P 


the  systematic  form  of  the  code  vector  with  r.  - k check  bits,  v^,  followed 
by  k message  bits,  m^. 

A "shortened"  code  results  if  all  the  code  vectors  having  z higher 
order  information  digits  equal  to  zero  (i.e.  „ = “k-g-n  = 

are  deleted  from  {v}.  The  result  is  a linear  (n  - z,  k - z)  code  which 
is  not  cyclic.  Note  that  the  code  vector  set  of  the  shortened  code  is 
{V}  with  some  code  vectors  deleted. 

Let  the  received  code  vector  after  transmission  through  some  channel 
be  denoted  W(X).  Then  W(X)  is  given  by 


W(X)  » V(X)  + E(X) 


where  E(X)  is  a polynomial  corresponding  to  the  vector  of  additive  errors 
introduced  by  the  channel. 

Error  detection  is  achieved  by  observing  the  "syndrome",  S(X), 
which  is  the  remainder  resulting  from  dividing  W(X)  by  g(X).  Since 
W(X)  is  the  sum  of  V(X),  (which  is  a multiple  of  g(X)),  and  E(X),  S(X) 
will  be  zero  for  the  case  of  no  errors  for  which  E(X)  = 0.  Unfortunately 
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S(X)  is  also  zero  if  E(X)  is  some  multiple  of  g(X),  in  which  case  there 
are  "undetectable  errors."  Note  that  the  class  {V(X)}  of  code  vectors 
is  generated  by  multiples  of  g(X).  Therefore  the  class  of  undetectable 
error  vectors  is  identical  with  the  class  of  code  vectors  {V(X)}. 

The  following  are  some  error  detecting  properties  of  cyclic  codes: 


All  single  errors  are  detected  if  g(X)  has  more  than  one  term. 

If  g(X)  contains  a factor  1 + Xc,  any  odd  number  of  errors  will 
be  detected. 

A code  generated  by  g(X)  detects  all  single  and  double  errors  if 
the  length  n of  the  code  is  no  greater  than  the  exponent  e to  which 
g(X)  belongs.  ( g(X)  belongs  to  exponent  e if  e is  the  least 
positive  integer  such  that  g(X)  evenly  divides  X6  + 1.). 

For  any  m there  is  a double  error  detecting  (Hamming)  code  of 
length  n = 2m  - 1 generated  by  a g(X)  of  degree  m. 

Any  cyclic  code  generated  by  a g(X)  of  degree  n - k detects  any 
error  burst  of  length  n - k or  less. 

The  fraction  of  bursts  of  length  b > n - k that  are  detected  is 
2-(n-k-l)  lf  b = n . k+1 
2'(n-k)  if  b > n . k+1 
Cyclic  (Fire)  codes  generated  by 

g(X)  = (xc  + 1)  §1(x) 

will  detect  any  combination  of  two  bursts  if: 

(i)  c + 1 s sum  of  burst  lengths 

(ii)  g^(X)  is  irreducible  and  a degree  at  least  as  great 
as  the  length  of  the  shorter  burst 

(iii)  n £ least  common  multiple  of  c and  the  exponent  e to 
which  g^(X)  belongs 

An  important  class  of  codes,  which  will  be  used  in  Part  II  of  this 
report,  are  referred  to  as  BCH  codes.  These  codes  can  be  constructed 
in  a systematic  manner.  For  any  choice  of  ra  and  t there  exists  a BCH 
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code  of  length  2m  - 1 which  is  guaranteed  to  detect  any  combination  of 
2t  errors.  The  generator  polynomial  of  such  a code  is  of  degree  no 
greater  than  mt. 

The  procedure  for  constructing  the  most  important  type  of  BCH  codes, 

referred  to  as  narrow-sense  or  primitive  BCH  codes,  is  the  following. 

Let  a be  a root  of  a primitive  polynomial  of  degree  m.  The  polynomial 

m(X),  which  is  the  binary  polynomial  of  smallest  degree  for  which 

m(o')  = 0,  is  referred  to  as  the  "minimal  polynomial"  of  a.  Consider  the 
2 3 2t 

sequence  a,  a , a , ...  a of  consecutive  powers  of  a and  denote  by 
m^(X)  the  minimum  polynomial  of  a*.  Then  the  generating  polynomial  of 
a 2t-error-detecting  BCH  code  is  the  least  common  multiple  of  m^(X), 

...  nu^fX).  Since  it  can  be  shown  that  every  even  power  of  a 
has  the  same  minimum  polynomial  as  some  previous  odd  power,  the  generating 
polynomial  can  be  expressed  concisely  as 

g(X)  = LCM  [m^X),  m3(X),  ...  m^^CX)]  (1.96) 

The  degree  of  each  minimal  polynomial  m^(X)  constructed  as  indicated  from 
a , which  is  a root  of  a primitive  polynomial  of  degree  m,  is  m or  less. 

Thus  the  degree  of  g(X)  is  at  most  mt. 

Tables  of  primitive  and  minimal  polynomials  of  various  degrees  are 
available  in  the  literature.  Perhaps  the  most  widely  used  table  is  found 
in  Peterson  [17],  pp.  472  - 492.  This  table  lists  all  irreducible 
polynomials  (including  primitive  polynomials)  of  degree  16  or  less  and  a 
primitive  polynomial  with  a minimum  number  of  nonzero  coefficients  and 
polynomials  belonging  to  all  possible  exponents  for  each  degree  17 
through  34.  For  each  degree,  m,  the  table  lists  a primitive  polynomial 
with  a minimum  number  of  nonzero  coefficients.  Denoting  a as  a root  of 
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this  primitive  polynomial,  the  table  also  lists  minimum  polynomial.',  ot 
for  J ode'. 

To  illustrate  the  use  of  the  table  in  constructing  BCH  codes, 
consider  the  problem  of  constructing  a code  of  length  at  least  2000  bits 
with  32  check  bits  which  can  detect  as  many  errors  as  possible. 

The  degree  of  g(X)  is  equal  to  the  number  of  check  bits  and  the 
length  of  the  code  is  2m  - 1.  This  results  in  the  constraints 

32  = mt 

2000  2 2m  - 1. 

Since  2^  - 2048  and  2^  = 1024,  the  last  constraint  forces  m to  be 

greater  than  or  equal  to  11.  If  there  are  to  be  exactly  32  check  bits, 

•f* 

then  t = 1,  m = 32  and  t = 2,  m = 16  are  possible  combinations.  For 
t = 1 any  primitive  32  degree  polynomial  from  the  table  would  serve 
for  g(X) . For  t = 2, 

g(X)  - LCM  [m^(X) , tn3(X)] 

where  m^(X)  is  a primitive  16th  degree  polynomial  selected  from  the 
table.  If  a is  a root  of  m^(X),  then  m^CX)  is  the  minimum  polynomial 

3 

of  a , a polynomial  which  can  also  be  found  in  the  table. 


These  codes  are  guaranteed  to  detect  any  combination  of  2t  errors  since 
a shortened  cyclic  code  has  at  least  as  great  a minimum  distance  as  the 
cyclic  code  from  which  it  is  derived  and  it  can  detect  any  burst-error 
patterns  that  the  original  code  could  detect. 

Since  the  second  code  with  t = 2 has  the  greater  guaranteed  error 
protection,  one  would  be  inclined  to  chose  it.  However,  a principle 
result  of  this  research  is  to  show  chat  this  approach  is  not  the  best 
for  real  channels. 
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3.  Channel  Models  Chosen  for  the  Code  Study 


Renewal  models  were  chosen  for  the  code  study  for  three  reasons, 
namely:  they  accurately  approximate  HF  and  wireline  channels  which  are 
important  in  the  Defense  Communications  system,  data  has  been  compiled 
and  used  to  determine  the  parameters  of  such  models  to  match  practical 
systems  and  finally  work  with  nonrenewal  models  in  terms  of  both  theory 
and  the  necessary  practical  data  does  not  seem  to  be  sufficiently  advanced 
to  justify  a general  code  study  base!  on  these  models. 

Ten  renewal  models  were  chosen  for  the  study,  namely: 

a)  The  Pareto  model  used  by  Johnson  [21]  and  developed 

by  Bolkovic  et.al.  [28]  for  a switched  telephone  network. 

b)  A model  termed  the  Markov-Fritchman  model  developed 
for  an  HF  link. 

c)  A model  termed  the  Markov- Tasi  model  developed  for 
a different  HF  link  from  that  of  (b). 

d)  Seven  models  developed  by  Brayer  [26]  to  match  experimental 
data  from  the  AUTOVON  system. 

The  models  developed  by  Brayer  are  part  of  an  extensive  study  done  by 
MITRE  in  conjunction  with  the  DICEF  facility  at  RADC.  Brayer's  report  [26] 
should  be  consulted  for  the  details  of  developing  the  models.  Generally 
speaking  the  experimental  data  was  taken  from  parts  of  the  continental 
AUTOVON  system  involving  two  to  five  switches  at  data  rates  of  4800  b/s 
and  9600  b/s.  A total  of  approximately  20,000  error  bursts  of  length 
greater  than  32  bits  was  found  in  the  data  with  approximately  5000  of  these 
bursts  in  the  4800  bit/sec  data  and  approximately  15,000  in  the  9500  bit/sec 
data. 

A summary  of  the  models  is  given  below: 

n + \~a  - x~a 

Pareto  Model  F(n  + 1)  = ^ ^ ” 0 £ n £ L - 1 

(1  - L~a) 

L = [ ~ (E(n)  + 1)] 
oi  = 0.3,  E(n)  » 3 x 104 
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Markov- Frltchman 


0.66 

0 

0.34 

T = 

0 

0.9991 

0.0009 

0.44 

0.34 

0.22 

Markov- Tsai 

0.99911 

0 

0.00089 

T = 

0 

0.73644 

0.26356 

0.36258 

0.58510 

0.05232 

Brayer  Table  3 (two  switches  - 4800  b./s) 


0.9754047 

0.0 


0.0 

0.9995566 

0.0 

0.2505878 


0.0 

0.0 

0.9999969 

0.0895789 


0.0245953 

0.0004434 

0.0000031 

0.1466708 


0.0 

0.5131625 
P(l)  = 3.39  x 10 


Brayer  Table  4 (three  switches  - 4800  b/s) 


0.2156599 

0.0 

0.0 

0.0 

0.0 

0.7843401 

0.0 

0.8886233 

0.0 

0.0 

0.0 

0.1113767 

0.0 

0.0 

0.9987018 

0.0 

0.0 

0.0012982 

0.0 

0.0 

0.0 

0.9999393 

0.0 

0.0000607 

0.0 

0.0 

0.0 

0.0 

0.999S977 

0.0000023 

0.1124190 

0.1780878 

0.1994085 

0.2057504 

0.0209361 

0.2833981 

P(l)  = 7.93  x 10 
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Braver  Table  5 (four  switches  - 48OO  b/s) 


0.9611693 

0.0 

0.0 

0.0 

0.0 

0.0388307 

0.0 

0.8898716 

0.0 

0.0 

0.0 

0.1101284 

0.0 

0.0 

0.9988276 

0.0 

0.0 

0.0011724 

0.0 

0.0 

0.0 

0.9999507 

0.0 

0.0000483 

0.0 

0.0 

0.0 

0.0 

0.9999969 

0.0000031 

I 0.204437b 

0.2271502 

0.0585721 

0.0422230 

0.0166381 

0.4509793 

P(l)  = 1.58  x 10"4 

Braver  Table  6 (five  switches  - 4800  b/s) 


0.9068574 

0.0 

0.0 

0.0 

0.0931426 

0.0 

0.9930199 

0.0 

0.0 

0.0019801 

T = 

0.0 

0.0 

0.9999507 

0.0 

0.0000493 

0.0 

0.0 

0.0 

0.9999981 

0.0000019 

0.3606889 

0.0668155 

0.0379466 

0.0305986 

0.5039504 

P(l) 

= 6.05  x 

10-5 

Brayer  Table  7 (two  switches-9600  b/s)  Brayer  lable  8 (three  switches-9600  i « ■' s y 

0.9982993  0.0  0.0017119  | 

T = 10.0  0.9999922  0.0000078!  T = ! 0.0  0.9999714  0.0000286 

0.3635153  0.2268990  0.4095857, 


0.9995636 

0.0 

0.0004364 

0.0 

0.9999922 

0.0000078 

T = 

0.48 74C04 

0.1026200 

0.4099796 

L. 

= 7.01  X 

10'5 

P( 

Brayer  Table  9 (four  switches-9600  b/s) 


T = 


0.9999391 


0.0000609 


(_0. 3979892  0, 6020108 j 

P(l)  = 1.52  x 10'4 


Useful  relations  for  renewal  models  of  several  types,  including  those 
chosen  for  further  study,  are  summarized  in  Table  1.1. 


b-5 


P(l)F(j)R(m,n-j+l)  , 1 s m S n [ £ P(1)F(1<)F( 


Markov  Models 


References 


!•  E.  0.  Elliott,  "Estimates  of  Error  Rates  for  Codes  on  Burst  Noise 
Channels,'1  Bell  Svst.  Tech.  J. . Vo] . 42,  Sept,  1963,  pp.  1977-1997. 

2.  E.  0.  Elliott,  "A  Model  of  the  Switched  Telephone  Network  for  Data 
Communications,"  Bell  Syst.  Tech.  J..  Vol.  44,  Jan.  1965,  pp.  85-109. 

3.  B.  D.  Fritchman,  "A  Binary  Channel  Characterization  using  Partitioned 

Markov  Chains,"  IEEE  Trans.  Inform.  Theory.  Vol.  IT-13,  April  1967, 
pp.  221-236.  ' “ ~ 

4.  E.  N.  Gilbert,  "Capacity  o/  a Burst  Noise  Channel,"  Bell  Syst.  Tech.  J., 
Vol.  39,  September  1960,  pp.  1253-1265. 

5.  J.  P.  Adoul,  B.  D.  Fritch&an,  and  L.  N.  Kanal,  "A  Critical  Statistic 
for  Channels  with  Memory,"  IEEE  Trans.  Inform.  Theory,  Vol.  IT-18, 

Jan.  1972,  pp.  133-141.  > - 

6.  S.  Tsai,  "Simple  Partitioned  Markov  Chain  Model  and  Troposcatter 
Channel,"  NTC-73,  Atlanta,  Georgia,  November  1974,  pp.  16F-1  - 16F-6. 

7.  S.  Tsai,  "Markov  Characterization  of  the  HF  Channel,"  IEEE  Trans,  on 
Connunlcations  Technology,,  Vol.  COM-17,  Feb.  1969,  pp.  24-32. 

8.  S.  Tsai,  "Analytic  Method  for  Evaluating  Error  Correcting  Codes  on  a 
Real  Channel,"  ICC-72. 

9.  R.  T.  Chien,  A.  H.  Haddad,  B.  Goldberg,  and  E.  Meyers,  "An  Analytic 
Error  Model  for  Real  Channels,"  ICC-72,  Philadelphia,  Pa.,  June  1972. 

10.  J,  M.  Berger  and  B.  Mandelbrot,  "A  New  Model  for  Error  Clustering  in 
Telephone  Circuits,"  IBM  J.  Res.  Div. , Vol.  7,  July  1963,  pp.  224-236. 

11.  S.  M.  Suasman,  "Analysis  ci  the  Pareto  Model  for  Error  Statistics  on 
Telephone  Circuits,"  IEEE  Traus.  on  Comroun.  Systems,  Vol.  CS-11. 

June  1963,  pp.  213-221. 

12.  P..  G.  Gallager,  Information  Theory  and  Reliable  Communication,  Wiley, 

New  York,  1968  (Chapter  6). 

13.  M.  Munter  and  J,  K.  Wolf,  "Predicted  Performances  of  Error-control 
Techniques  over  Real  Channels,"  IEEE  Trans.  Inform,  Inform.  Theory. 

Vol.  IT-14,  Sept.  1968,  pp.  640-650. 

14.  H.  A.  Blank  and  P.  J.  Trafton,  "A  Markov  Error  Channel  Model,"  NTC-73, 
Atlanta,  Georgia,  November  25-28,  1973,  pp.  15B-1  - 15B-8. 

15.  P.  A.  Bello,  "A  Troposcatter  Channel  Model,"  IEEE  Trans,  on  Communication 

Technology.  Vol.  COM-17,  April  1969.  " ~ 

16.  J.  Goldman,  "Multiple  Error  Performance  of  PSK  Systems  with  Cochannel 
Interference  and  Noise,"  IEEE  Trans,  on  Communication  Technology, 

Vol,  COM-19,  August  1971,  pp.  420-430. 


47 


17 


. W.  W.  Peterson  and  E»  J.  Weldon,  Jr.,  Error  Correcting  Codes, 

(Second  Edition),  MIT  Press,  Cambridge,  1972. 

18.  S.  Liu,  An  Introduction  to  Error-Correcting  Codes,  Prentice-Hall, 
Englewood  Cliffs,  1970. 

19.  F.  P.  Corr,  "Statistical  Evaluation  of  Error  Detection  Cyclic  Codes 
for  Data  Transmission,"  IEEE  Trans,  on  Communications  Systems, 

June  1964,  pp.  211-216. 

20.  W.  Peterson  and  D.  Brown,  "Cyclic  Codes  for  Error  Detection,"  Proc.  IRE 
Vol.  49,  Jan.  1961,  pp.  228-235. 

21.  D.  C.  Johnson,  "Performance  of  the  SDLC,  CRC-16  and  CCITT  Polynomials 
with  NP.ZI  Coding,"  X3S34  and  CRC  Ad  Hoc  Group  Memo,  April  1972. 

22.  R.  £.  Townsend  and  T.  N.  Watts,  "Effectiveness  of  Error  Control  in 
Data  Communication  over  the  Switched  Telephone  Network,"  BSTJ , Vol.  43, 
Nov.  1964. 

23.  K.  Brayer  and  0.  Cardinale,  "Evaluation  of  Error  Correcting  Block 
Encoding  on  High-Speed  HF  Data,"  IEEE  Trans.  Comm.  Tech,  June  1967. 
pp.  371-382. 

24.  K.  Brayer,  "Error  Patterns  Measured  on  Transequatorial  HF  Coranunication 
Links,"  IEEE  Trans.  Comm.  Tech,  April  1968. 

25.  K.  Brayer,  "Error  Correction  Code  Performance  on  HF,  Troposcatter, 
and  Sattellite  Channels,"  IEEE  Trans.  Comm.  Tech,  Vol.  Com-19, 

Oct.  1971,  pp.  781-789. 

26.  K.  Brayer,  "Characterization  and  Modeling  of  the  Digital  High-Speed 
Autovon  Channel,"  Interim  Report  MTR2802,  1 May  1974  MITRE  Corp. 

27.  R.  T.  Chien,  et.al.,  "Analytical  Mathematical  Models  of  Tactical 
Military  Communications  Channels,"  Quarterly  Report,  September  1973, 
Research  and  Development  Technical  Report  ECOM-0292-7. 

28.  M.  D.  Baikovrc,  et.al.,  "High-Speed  Data  Transmission  Performance 
on  the  Switched  Telecommunications  Network,"  B.S.T.J. , April  1971. 

29.  J.  Salz  and  B.  R.  Saltzberg,  "Double  Error  Rates  in  Differentially 
Coherent  Phase  Systems,"  IEEE  Trans,  on  Communication  Systems, 

Vol.  CS-12 , June,  1964,  pp.  202-205. 

30.  R.  Ash,  Information  Theory.  New  York:  Interscience  Publishers,  1965. 

31.  B.  u . Fritchman,  "A  Binary  Channel  Characterization  Using  Partitioned 
Markov  Chains  with  Applications  to  Error  Correcting  Codes,"  Ph.D. 
Thesis,  Lehigh  University,  1967. 


43 


PART  II 


CODE  EVALUATION  USING  RENEWAL  CHANNEL  MODELS 


1.  Probability  of  Undetectable  Errors  for  Renewal  Channel  Models 

As  discussed  in  Part  I,  several  channel  models  are  discussed  by  a 

number  of  authors,  typical  references  are  l]  and  [lOj.  The  basic 

assumption  of  renewal  models  is  that  the  "gap"  intervals  between  errors 

are  independent  random  variables.  Figure  2.1  illustrates  the  definition 

of  gap  length,  d,  as  one  plus  the  number  of  nonerrors  between  two  errors. 

error  gap 


1 | 0 0 ••••  0 

l« d 

Figure  2.1  A Typical 


1 


0 


till 


* 


Error  Gap 


Two  gap  statistics  are  useful,  namely: 

p(d)  = P{0d  1 ill}  - the  probability  of  exactly  d-1 

nonerrcrs  followed  by  an  error  in 
the  error  pattern,  given  an  error 
starting  the  pattern. 

F(d)  = P{0d  ^ jl}  - the  probability  of  at  least  d-1 

nonerrors  followed  by  an  error, 
given  an  error  starting  the  pattern. 


The  two  statistics  are  related  by  the 

equations 

ao 

i 

00 

F(d)  = Z Pio  111}  ■ 

= Z p(k) 

(2.1) 

k=d- 1 

k=d 

p(d)  = F (d)  ~ F(d+1)  . 

(2.2) 

A central  objective  in  the  study  of  error  detecting  codes  is  an 
evaluation  of  the  probability,  P^(n),  of  undetected  error  for  a particular 
code  for  blocks  of  length  n.  Techniques  are  '.vailable  for  identifying 
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undetectable  error  patterns  for  given  codes.  Given  a particular  error 
pattern,  e,  its  probability,  P(e.),  can  be  computed  for  a particular 
channel  model.  The  sum  of  the  probabilities  of  all  undetectable 
error  patterns  is  the  undetected  error  probability  for  the  code  based 
on  the  assumed  channel  model. 

Figure  2.2  shovs  a particular  undetectable  error  pattern,  e,  for 
a block  of  length  n. 


Figure  2.2  Undetectable  Error  Pattern 


It  is  useful  to  identify  the  "burst  length,"  b,  containing  all  of  the 

errors  and  a particular  "burst  pattern,"  e , beginning  with  the  first 

b 

error  and  ending  with  the  last  error. 

For  a cyclic  code  an  undetectable  error  pattern  will  result  from 
every  position  of  the  burst  pattern  within  the  block  n.  Thus  undetectable 
error  patterns  exist  for  every  d^  in  the  interval  1 5d^  in  - b A 1, 
where  d is  constrained  to  satisfy 

WtI 

d =n-b+l-d.  . (2.3) 

w+1  1 


The  probability  of  the  pattern,  e,  of  Figure  2.2  can  be  computed 


as  follows.  The  internal  gaps  of  length  dOJ  d0,  ••••  d each  have  a 
probability  given  by  P(d^).  Since  the  gap  lengths  are  independent  for 
renewal  models,  the  probability,  Pg[e^(w,b)j,  of  the  internal  gap 


50 


pattern  in  the  burst  is  given  by 


p [e,  (w,b)]  * rr  P(d  ) , (2.4) 

8 1*2 

where  each  has  a value  corresponding  to  the  particular  pattern, 

Note  that  w is  the  number  of  errors,  or  the  weight,  of  the  burst  pattern. 

The  probability  of  the  gap  beginning  the  pattern  is  the  probability 
of  at  least  d^  - 1 zeros  in  the  error  pattern  followed  by  a one.  Note 
that  the  one  starting  the  gap  is  at  an  unspecified  position  outside 
the  block  being  considered.  The  probability  of  the  beginning  gap  can 
be  expressed  as 

00  •••  01}  * P{0d'i  |1}  P(l)  = P(l)  F(d1)  (2.5) 

using  the  relation  for  conditional  probability.  Similarly  the  probability 
of  the  ending  pattern  is  just  the  probability  of  at  least  d^+^  zeros 
given  a one  to  start  the  pattern,  or  F^^^  + 1).  Note  that  in  this 
case  the  one  ending  the  pattern  is  outside  of  the  block  being  considered. 

Since  the  gaps  beginning  and  ending  the  block  are  statistically 
independent  of  the  others  for  a renewal  channel,  the  probability,  P(e), 
of  all  of  the  gaps  in  a particular  pattern  is  given  by 

P(e)  = P(l)  F(dx)  F(dw+1  + 1)  Pg[eb(w,b)]  (2.6) 

The  total  probability,  P(eb;n),  of  all  undetectable  error  patterns 

★ 

which  include  the  burst  pattern  e^  in  all  of  its  possible  positions  can 
be  expressed  as 

n-b+1 

P(e  ;n)  = P(l)  P [e  (w,b)]  £ F(d  ) F(n  - b + 2 - d ) (2.7) 

D 8 D d1*l  1 L 

Note  that  the  total  probability  is  just  the  sum  of  the  separate  pattern 

probabilities  since  the  patterns  are  mutually  exclusive. 

* Code  vectors  severely  truncated  from  their  "natural"  length  are  typical 
in  the  present  study.  Thus  patterns  shifted  to  fold  over  the  end  of  the 
block  are  not  considered. 
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It  is  useful  to  define  a variable  Sp(n,b)  by  the  equation* 

. n-b+1 

So(n,b)=^  £ F(dx)  P(n  - b - dx  + 2), 

dri 


(2.8) 


so  that  P(e^;n)  is  expressed  simply  as 


P(e  ;n)  = n P(l)  P [e.  (w,b)]  S (n,b).  (2.9) 

b g b p 

The  probability  of  undetectable  errors  for  a particular  code  is 
obtained  by  summing  over  the  probability  of  ail  undetectable  patterns 
for  the  code.  Equation  (2.9)  gives  the  probability  of  all  cyclical  shifts 
of  a pattern  with:  (i)  fixed  burst  length,  b,  (ii)  fixed  weight,  w,  and 
(iii)  a fixed  distribution  of  the  errors  within  the  burst,  as  specified  by 
fixed  d^,  i=2,  ...  w.  To  obtain  the  total  probability  of  undetectable 
errors  for  a given  code,  probabilities  P(e^;n)  must  be  computed  and  summed 
over  the  class,  W,  of  all  of  the  variables  listed  above,  namely:  all 

burst  lengths,  all  weights  and  all  distributions  of  errors  of  fixed  weight 
within  a given  burst  length.  The  result  can  be  expressed  as 

P (n)  = n ?(1)  £ S (n,b)  P [e  (w,b)j  = £ P(e  ;n)  (2.10) 

u w P g b y b 

2.  Approaches  to  Code  Evaluation 

Probability  of  undetected  error  is  the  chief  measure  of  the  quality 
of  an  error  detecting  code.  In  principle  for  a given  code  and  channel 
model  all  undetectable  error  patterns  can  be  identified,  the  probability 
of  each  can  be  computed  and  the  probability  of  undetected  error  obtained 
from  (2.10).  The  difficulty  with  this  procedure  is  the  fact  that  if  the 
number  of  message  bits  is  k,  then  there  are  2 undetectable  error 
patterns.  The  last  statement  follows  from  the  fact  that  the  set  of 
undetectable  error  patterns  is  identical  with  the  set  of  cade  vector  patterns. 


* Tli is  definition  is  suggested  by  Johnson  [21]  in  an  unpublished  memo. 
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For  example  If  the  block  length  Is  2000  and  there  are  32  cheek  bits, 
k 592 

k is  1968  and  2 is  10  , a number  too  large  to  permit  computation  of  all 

pattern  probabilities. 

Johnson  in  his  unpublished  memo  [21]  estimates  the  probability 
of  undetected  error  by  computing  and  summing  the  probabilities  of 
undetectable  error  patterns  with  fairly  short  bursts  and  relatively 
few  errors.  Johnson's  computational  algorithm  requires  a search 
through  all  patterns  of  fixed  length  and  weight  to  find  the  undetectable 
patterns.  Computing  time  limits  such  a search  to  weights  on  the  order 
of  6 and  less  and  bursts  of  length  on  the  order  of  100  bits.  Using  10 
to  15  minutes  of  large  general  purpose  computer  time,  thirty  to  fifty 
undetectable  error  patterns  can  be  found  and  processed  in  this  way 
to  produce  an  estimate  of  the  probability  of  undetectable  error. 

3.  Development  of  an  Efficient  Algorithm  for  Code  Evaluation 

Consider  (2.10)  which  expresses  the  probability  of  undetectable 
errors  for  a given  code,  a given  block  length  and  a given  channel  model. 

In  particular  consider  the  quantity,  S^(n,b),  in  this  equation.  Curves 
of  Sp(n,b)  versus  b have  been  computed  for  a number  of  renewal  channel 
models  with  different  choices  for  the  ;ap  distribution  function  and  the 
results  are  given  in  Appendix  I as  Figures  A.17»A.20.  Examination  of  these 
curves  shows  empirically  that,  (at  least  for  the  models  considered),  S^(n,b), 

can  be  approximated  by  a constant,  (n),  which  is  independent  of  b. 

P 

Thus  a reasonable  approximation  for  Pu(n)  is  given  by 

P (n)  s n P(l)  3 (n)  £ P [e,  (w,b)1  (2.11) 

u P W g b 
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It  also  follows  from  (2.10)  that  exact  upper  and  lower  hounds  on 
P^Cn)  are  given  by 


n P(l)  S*  (n)  IP  s P (n)  S n P(l)  s"(n)  Z P (2 . 12> 

P W 8 u P W 8 


where 

S*(n)  = min  S (n,b)  (2.13) 

P b P 

'k'k 

S (n)  = max  S (n,b)  (2.14) 

P b P 


Note  in  (2.11)  that  (n ) is  expressed  as  the  product  of  the  term 

n P ( 1 ) S (n),  which  is  independent  of  the  cede,  and  the  term  1 P 
P W & 

which  depends  on  the  code.  The  bounds  in  (2.12)  break  up  into  two  terms 

in  a similar  way  with  Z P again  being  the  code  dependent  term. 

W 8 

in  comparing  two  codes  with  respect  to  probability  of  undetectable 

errors.it  thus  seems  reasonable  to  use  Z P as  a figure  of  merit.  The 

W 8 

figure  of  merit  is  proportional  to  probability  of  undetectable  errors, 
or  bounds  on  this  quantity,  for  a fixed  block  length,  n,  and  a fixed 
channel  model. 

A tractable  algorithm  for  computing  an  approximation  to  Z P is 

W 8 

now  developed.  First  consider  the  expression 


Ip  =Z  p +Z  p (2.15) 

W 8 wx  8 w?  8 

which  partitions  the  sum  over  all  undetectable  error  patterns  inlo  two 

parts.  The  quantity  Z P , summing  the  probability  of  selected 

Wj  8 

undetectable  error  patterns,  will  be  used  co  approximate  Z P . The  set 

W g 

will  be  chosen  to  include  all  of  the  high  probability  error  patterns 

so  that  Z P is  made  negligible  in  comparison  to  Z P . 

W2  8 Wx  8 
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To  specify  the  set  W^,  consider  the  code  vector  pattern,  or  equivalently 
the  undetectable  error  pattern,  with  y check  bits  shown  in  Figure  2.3 


check  bits 


0 •••  1 0 0 ••  1 10 


message  bits 


t- 


-H- 


0 •••  100  •••  1 0100  • ••  0 


-t- 


-tr 


0 y-1  t n-1 

Figure  2.3  A Typical  Code  Vector  Pattarn  with  y Check  Bits 


For  the  pattern  of  Figure  2.3.  ? is  determined  as  the  product  of  the 

s 

probabilities  of  the  specified  gaps  beginning  after  the  first  error 

and  continuing  to  include  the  last  error,  as  expressed  it.  (2.4). 

The  error  gaps  involved  in  computing  P can  be  classified  as 

& 

contributing  to  three  probabilities,  namely: 

P - probability  of  the  gaps  in  the  check  bit  portion 
of  the  pattern 

PT  - probability  of  the  transition  gap  between  the 
check  bits  and  the  message  bits 

P^  - probability  of  gaps  in  the  message  portion 
of  the  pattern. 

Thus  P is  expressed  as 
g 

P - tt  P(d  ) = P P P . (2.15) 

8 i=2  1 C T M 

Since  Z)  P contains  a term  for  every  possible  message  pattern, 

W 8 

the  message  patterns  can  play  the  role  of  an  independent  variable  in 
constructing  undetectable  error  vectors  through  use  of  standard  coding 
algorithms.  Furthermore,  from  (2.15),  it  can  be  noted  that  large  values  of 
Pg  will  res  tit  if  both  P^  and  P^,  P^  are  large.  Large  P^  is  a necessary  but 
not  sufficient  condition  for  a large  P^. 

/N 

Now  consider  a set,  W^,  of  message  patterns  constructed  so  that  for 
each  pattern 


PM  * f 


(2.16) 
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The  patterns  in  this  set  can  be  used  to  construct  code  vectors  which 
satisfy  the  necessary  condition  for  large  P . 

With  reference  to  the  typical  code  vector  pattern  of  Figure  2.3,  note 

that  only  the  probabilities  of  the  gaps  within  the  error  burst,  Ci.e.  the 

bits  following  the  first  error  and  extending  to  and  including  the  last 

error),  effect  P_  by  the  way  in  which  it  is  defined.  Furthermore,  aince 

g 

the  code  is  cyclic,  every  possible  shifted  position  of  a basic  pattern 
will  also  appear  in  a code  vector.  The  cyclic  shifts  of  a fixed  basic 

pattern  are  accounted  for  by  the  factor  ^(n)  in  (2.11)  and  hence  only  one 

position  of  a basic  pattern  should  be  included  in  a final  set  W,.  This  is 
accomplisned  by  including  in  only  those  code  vectors  of  which  begin 
with  a one  in  the  first  position. 

Relative  to  constructing  the  message  pattern  set,  consider  the  case 
for  which  the  first  one  in  a message  pattern  being  considered  is  located 
at  1 as  shown  in  Figure  2.3.  The  combined  length  of  the  gaps  in  the  check 
bit  pattern  and  the  transition  gap  is  thus  l . 

It  is  convenient  in  computational  work  to  construct  the  class  of 
message  vectors  so  that 

PH)  PM  * 9 , (2.18) 

which  partially  accounts  for  the  transition  gap  in  setting  the  bound. 

(It  can  be  shown  that  p(<6)  is  the  maximum  probability  of  the  check  and 
transitions  gaps,  given  that  the  first  message  bit  is  located  at  > . ) 

Since  t and  hence  P(£)  is  determined  by  each  particular  message  pattern, 
in  theoretical  work  it  is  more  convenient  to  maximize  p(^)  over  all  values 
of  i to  obtain  p(y)  which  is  independent  of  the  particular  message  pattern. 
In  such  a case  message  vectors  would  be  constructed  to  satisfy 

P(v)  PM  * S , (2.19) 
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which  yields  a slightly  different  class.  Either  (2.18)  or  (2.19)  can 


be  solved  for  a bound  on  P and  the  results  can  be  expressed  as 
P 2 = B* 

p(-0  p(y) 


( 2.20 ) 


It  is  now  possible  to  state  the  following  efficient  algorithm,  termed 
the  2 Pg  algorithm,  for  code  evaluation. 

2 P Algorithm 

s 

A 

Step  1.  Find  a set,  W.  , of  message  patterns  such  that  for  each  pattern 

1 * 

p(-t.)  P £ S,  or  alternately  P„  £ 0 . (This  set  can  be  used  for 
any  code  polynomial  but  the  set  depends,  weakly,  on  the  distribution 
function  for  the  error  gaps  as  specified  by  the  channel  modsl.) 

Step  2.  For  a given  code  polynomial  compute  the  check  bit  pattern 
corresponding  to  each  message  pattern  of  step  (1). 

Step  3.  Construct  the  code  vector  patterns  correspondong  to  each  message 

A 

in  the  set  W^.  These  patterns  are  also  undetectable  error  patterns. 
Step  4.  Discard  those  patterns  which  do  not  begin  with  a one  to  obtain 
a reduced  set  of  patterns,  W^,. 

Step  5.  Compute  P for  each  undetectable  error  pattern  of  step  4. 

Step  6.  Compute  P^  where  the  sum  extends  over  all  message  patterns  in 

the  set,  Wp  determined  in  step  (4). 

Note  that  through  use  of  (2.11)  2p  can  be  used  to  compute  the 

y 8 
1 

following  estimate,  Fu(n)  of  Pu(n) 


P (n)  -•  n P(l)  S (n)  2 P . 
u P Wj  S 

4.  Evaluation  of  2 P Algorithm. 

8 


(2.21) 


Three  sets  of  message  vectors  have  been  constructed  according  to  the 
data  in  Table  2.1.  Message  patterns  were  generated  using  the  condition  of 
(2.18)  for  the  values  of  0 specified  for  16  check  bits.  The  set  of  message 
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Table  2.1  Data  on  Message  Patterns 


No.  of  Patterns 

0 

9(16  check  bits)  5 (32  check  oits; 

864 

7.3  x 10"3 

1 

5.8  x 10'5  j 2.4  x 10"5 

6,117 

1.3  x 10'3 

1.0  x 10‘5  j 4.2  x 10‘6 

32,362 

2.7  x 10"4 

2.1  X 10"6  j 8.7  x 10"7 

. 

patterns  generated  is  slightly  different  than  would  have  been  obtained 
k 

from  using  the  S bound  and  the  tabulated  values.  In  the  table  note  that 
■k 

values  of  9 and  9 are  related  oy  (2.20). 

The  number  of  code  vector  patterns  comprising  is  approximately 
one-half  of  the  number  of  message  patterns  in  the  table  since  only  code 
vector  patterns  with  ones  in  the  first  bit  are  retained.  The  smallest 
set  (864  message  patterns)  includes  all  patterns  with  1,  2 and  3 errors 
(as  well  as  other  patterns)  while  the  largest  set  includes  all  patterns 
with  1,  2,  3,  4 and  5 errors  and  other  patterns. 

To  satisfy  a given  bound  on  P^,  in  principle  a new  set  of  message 
sequences  should  be  chosen  for  each  channel  model  since  gap  probabilities 
are  specified  by  the  model.  However,  for  any  distribution  function 
which  assigns  uniformly  less  probability  to  any  given  gap  than  the 
Pareto  distribution,  the  Pareto  message  set  will  also  satisfy  the  given 
bound. 
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The  gap  distribution  functions  plotted  in  Appendix  l,  Kic.re  A. i , show< 
several  channel  models  of  interest,  such  as  the  Markov- Fritch-nj.:’.  model, 
are  bounded  by  the  Pareto  distribution  so  that  the  Pareto  message  sets 
exactly  satisify  the  given  bound.  In  several  other  cases,  while  the 
Pareto  distribution  does  not  exactly  bound  the  distribution  function  of 
other  models,  it  is  approximately  equal  to  several  of  them  over  regions 
where  it  does  not  bound.  The  only  case  of  a substantial  difference 
between  the  Pareto  distribution,  either  as  a bound  or  as  approximately 
equality,  is  the  case  of  Brayer  Table  3.  Even  in  this  case  the 
difference  is  not  an  order  of  magnitude. 

In  the  body  of  the  study  only  the  Pareto  message  sets  were  used  for 
all  channel  models.  Convergence  of  the  72  P^  values  with  more  and  more 
message  sequences,  as  discussed  below,  is  taken  as  evidence  that  a 
sufficient  number  of  patterns  is  being  used  in  all  cases. 

The  72  P algorithm  was  found  to  be  very  efficient,  using  an  average 

o 

of  13  seconds  of  Univac  1108  Computer  CPU  time  to  evaluate  typical  32nd 
degree  polynomials. 

Table  2.2  presents  results  for  evaluation  of  the  ^P  algorithm  in 

8 

several  respects.  The  table  is  constructed  to  tabulate  P^  defined  by 

P (n) 

P =_y 

u n P(l) 

for  comparison  to  Johnson's  [21  ] determination  of  this  quantity  for 
several  codes,  where  the  quantity  Pu(n)  is  computed  from  (2.21)  . 
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constructed  for  a block  size  n ° 3200,  except  for  the  CRC-16,  CCITT  and  S0LC  polynomials 


Note  that  Johnson's  results  for  the  CRC,  CCITT  and  ShLC  codes  correspond 

closely  to  the  £ P results  for  864  message  sequences.  For  the  two  other 
8 

codes  evaluated  in  the  present  study  using  his  method,  the  results  seem  to 
fall  between  the  864  and  the  6,117  message  sequence  data. 

The  data  in  Table  2.2  can  also  be  used  to  form  a judgement  as  to 
the  rate  of  convergence  of  £ P to  a limiting  value  as  more  and  more 

s 

message  sequences  are  used.  In  this  regard,  note  that  for  the  CRC- 16 
polynomial,  for  which  £ P is  large,  little  change  in  Zi  P results  from 
the  change  from  6,117  message  sequences  *0  32,362  message  sequences. 

For  the  polynomials  with  smaller  Z P , however,  the  results  converge 
less  rapidly  with  the  number  of  message  sequences.  For  the  smallest 

in  the  table,  (that  for  polynomial  150355),  the  fractional  increment 

8 

for  Z P between  864  and  6,117  message  sequences  is  101  whereas  that 
8 

between  6,117  and  32,362  message  sequences  is  2.02. 

Rate  of  convergence  was  studied  in  more  detail  for  a specific  32 

degree  polynomial  and  several  channel  models.  The  polynomial  chosen  hac 

close  to  the  smallest  Zp  for  all  channel  models.  The  results  presentee 

8 

in  Figure  2.4  seem  to  indicate  satisfactory  convergence,  and  hence  a good 
estimate  of  P^(n),  for  all  channel  models,  including  the  Braver  Table  3 ..loae 


5.  Results  of  Studies  using  the  Z P Algorithm 

O 

Two  extensive  computer  studies  of  classes  of  codes,  as  determined  by 
generator  polynomials,  were  carried  out.  All  900  irreducible  16th  degree 
polynomials,  as  listed  for  example  by  Peterson  [17^,  were  evaluated  using 

_5 

8 - 5 x 10  . The  results  are  given  in  Table  2.3  along  witn  the  results 

for  three  good  nonprimitive  polynomials. 

All  32nd,  31st  and  30th  degree  irreducible  polynomials  listed  in  the 
Peterson  tables  were  used  to  construct  32  check  bit  code  polynomials, 
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Table  2.3  L_  . Figures  of  Merit  for  Selected  16th  Degree  Polynomials 

Calculated  with  0 = 5 x 10  (864  information  bit  sequences) 


2 

Che  31st  and  30  degree  polynomials  being  multiplied  by  1 + x and  1 + x 
respectively.  The  table  lists  109  30th  degree,  11  31st  degree  and 
32nd  degree  polynomials.  Codes  based  on  each  of  these  polynomials  were 
investigated  for  the  Pareto  model.  The  £ P for  the  best  ones  in  each 

s 

group  is  *•  ibulated  in  Table  2.4  for  p=  4.2  x 10'6  and  8.7  x 10'7. 

Numbers  in  parentheses  in  the  first  column  indicate  the  rank  for 
-6 

8 = 4.2  x 10  within  groups  of  the  same  degree  polynomials.  Similar 
numbers  in  the  fourth  column  indicate  the  rank  for  8 - 8.7  x 10  7 over 
the  whole  group  of  codes. 

Table  2.4  H P r Values  for  "Good"  32nd  Degree  Polynomials  for  two  Values 
£ 

of  8 using  the  Pareto  Model 


Polynomial  Class 

Polynomial 

(Octal) 

Ip  x io"12, 

g 

g =4.2  x 10"6 

IPg  x 10~ 11 , 

3 = 8.7  x 10/  . 

i 

32  degree  (1) 

60537314115 

.56 

1.150  (6) 

32  degree  (2) 

40460216667 

1.00 

.270  (1) 

31  (1+X)  (1) 

60120240653 

66.77 

84.016  (7) 

30  (1+X)  (1) 

52414670717 

.601 

.749  (4) 

30  (1+X2)  (2) 

62613476131 

.970 

.291  (2)  ■ 

i 

30  (1+X2)  (3) 

51474633517 

1.094 

.459  (3) 

i 

30  (1+X2)  (4) 

54114300535 

1.420 

.815  (5)  j 

Several  classes  of  BCH-Fire  codes  were  constructed  to  satisfy  the 
requirement  of  32  check  bits  and  a block  length  of  2000  bits.  Such  codes 
have  generator  polynomials  of  the  form  [18] 
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As  discussed  in  Part  I of  the  report,  the  BCH  polynomial,  (X)  , 

can  be  expressed  as 

gBCH  <X)  = LCM  -ml  00  ’ m3  (X)»  •••»  m2  t-l(X)"J  (2'23) 

where  LCM  denotes  least  common  multiple,  and  m^  (X)  is  the  minimum 
polynomial  of  a1  where  a is  a root  of  a primitive  mth  degree  polynomial. 

For  an  effective  code  the  block  length,  n,  must  satisfy 

n = 2m  - 12  2000,  (2.24) 


from  which  m2  H, 

Since  each  m^(X)  in  (2.23)  has  degree  m or  less,  the  possible  code 
classes  of  the  form  given  in  (2.22)  which  have  32  check  bits  and  a block 
length  n 2 2000  are  the  six  listed  below: 


1.  (X10  + 1)  ^(X) 


a. 


(12), 

(12) 

m1  (X) 

(X) 

(13) 

(13) 

n1  (X) 

m2 

(X) 

(14)  x 

(14) 

m1  (X) 

n2 

(X) 

(15)  , 

(15) 

m^  (X) 

ra2 

(X) 

.2  i 


(X  " + 1)  m. 


(32  - 21) 


(X) 


Z P 7 was  computed  for  all  104  codes  cf  type  5 for  0 =4.2  x 10 


and  8.7  x 10 


-7 


The  results,  for  the  best  and  worst  codes,  are  given 


in  Table  2.5  with  a ranking  in  parentheses  in  the  first  column  for 
3 =4.2  x 1C  !)  and  a similarly  denoted  ranking  in  the  third  column  for 
3 =8.7  x 10’;. 
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Table 


2.5  Z P Values  for  a Selection  of  Code  Polynomials  of  the  Forr: 

28  (15)  (15) 

(X  + 1)  m^  (X)  (X)  for  Two  Values  of  9 using  the  Pareto  Model 


Polynomial 

(Octal) 

Zp  x 10  12, 

g -6 
9 = 4.2  x 10  ° 

(6117  message 
sequence) 

2 Pg  x io'11, 

3 = 8.7  x 10"7 

(32,362  message  > 
sequence)  | 

1 

47665475341 

(1) 

.636 

.380 

(5) 

56111263425 

(2) 

.718 

.260 

(3)  i 

1 

72450733617 

(3) 

.766 

.251 

i 

(2)  j 

54766326031 

(4) 

.858 

.185 

(i)  ; 

53760445455 

(5) 

1.188 

.880 

(8) 

43611250751 

(6) 

1.365 

.353 

(4) 

67007252603 

(7) 

1.441 

.849 

(7) 

70425300155 

(8) 

1.473 

.480 

(6) 

42323255113 

(100) 

87.03 

53614073271 

(101) 

101.67 

76577327771 

(102) 

124.22 

74467714763 

(103) 

222.11 

51224036761 

(104) 

3348.39 

i 

j 


all  codes  of  class  3 (4  channel  models) 

polynomials  75626604261  and  40050004005  suggested 
by  Brayer  and  McKee" 

A summary  of  the  results  for  the  best  polynomials  is  given  in  Table  6. 
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6.  Choice  of  a Code  Polynomial 


From  the  data  presented  in  Section  5,  it  is  clear  that  the  Z p 

8 

figure  of  merit  varies  over  many  orders  of  magnitude  for  the  polynomials 
investigated.  Furthermore,  Table  6 shows  that  the  figure  of  merit  is 
sensitive,  to  some  extent,  to  the  channel  model.  On  the  other  hand,  the 
sensitivity  to  the  channel  model  is  not  severe  and  a relatively  large 
number  of  the  codes  considered  in  Table  6 could  be  considered  essentially 
equivalent. 

The  best  code  polynomial  in  Table  6 for  a particular  channel  model 
can  be  easily  selected.  For  general  use  with  the  channel  model  unspecified, 
however,  there  seems  to  be  no  clear  cut  basis  on  which  to  choose  between 
several  polynomials  which  perform  exceptionally  well  for  some  channel 
models  and  less  well  for  others.  For  example,  a good  case  can  be  made 
.or  the  polynomials  (octal)  \0460216667,  54766326031,  70425300155, 
42370206413  and  75626604261  as  well  as  for  several  other  polynomials. 

To  be  specific,  the  polynomial  (octal)  40460216667  or 


g( 


x)  = x3^+  x26+  x23  + x22  + x16+  x12  + x11  + x10  + X 


.8 


7 5 4 2 

+ X + X + X + X + X + 1 


(2.25) 


was  chosen  for  recommendation  and  for  further  study. 

Table  2.7  lists  the  following  information  for  the  recommended  polynomial: 

a)  The  rank  of  the  polynomial  for  each  of  10 
models  with  respect  to  all  32nd  degree 
polynomials  evaluated 

b)  The  figure  of  merit,  Z P 

8 

c)  P ( 1 ) - the  probability  of  an  error 

d)  S 

P 

e)  Pu(n  = 2000)  = n S'^  P(l)  Z - an  estimate 
of  P (2000) 
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For  all  polynomials  studied. 


The  table  also  lists  the  figure  of  merit  and  estimated  probability  of 
undetected  error  for  the  best  polynomial,  (of  those  evaluated'),  for  each 
channel  model,  if  it  is  different  from  the  recommended  polynomial. 

The  parameter  "S  was  not  computed  for  channel  models  Brayer  Table  6, 

7 and  8 to  conserve  computer  time.  The  values  of  for  these  channel 
models  are  not  expected  to  differ  significantly  from  values  for  other 
models . 

It  can  be  noted  from  Table  2.7  that  the  recommended  polynomial  has  an 

estimated  probability  of  undetected  error  within  a factor  of  approximately 

3 of  the  best  polynomial  tailored  to  each  channel  model.  The  exact 

ratios  of  for  the  recommended  polynomial  to  that  of  the  best 

polynomial  for  each  channel  model  are  1.45  (Pareto),  1.33  (Fritchman), 

3.14  (Bra-  >r  Table  4)  and  3.47  (Brayer  Table  9).  For  four  models  the 

recommended  polynomial  is  the  best  for  the  particular  channel.  For  the 

two  models  for  which  T>  and  hence  P was  not  computed,  the  ratio  of 

p u 

P for  the  recommended  polynomial  to  that  of  the  best  polynomial  for 
6 

the  channel  is  2.77  (Brayer  Table  7)  and  1.3  (Brayer  Table  8). 

As  noted  in  Section  4,  the  curves  of  Figure  2.4  indicate  the  rate  of 

convergence  of  the  £ P algorithm  for  the  recommended  polynomial  as  more 

© 

and  more  message  sequences  are  used  in  the  computation*  Note  that  in 

most  cases  the  change  in  £ ? is  almost  negligible  as  the  number  of 

8 

patterns  is  increased  from  24,000  to  32,000. 

As  a final  comment  on  the  recommended  polynomial,  consider  the 

following  typical  use.  At  a bit  rate  of  10^  bits/sec,  approximately 

5 x 10^  2000  bit  patterns  are  transmitted  per  day.  Interpreting  probability 

as  relative  frequency,  the  largest  estimated  probability  of  error  in  Table  2.7, 
-12 

namely  1.3  x 10  , produces  approximately  one  error  on  the  average  for  every 

10^  2000  bit  patterns.  This  o.curs  in  2 x 10^  days  or  something  like  50  years. 
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7.  Conclusions  for  Part  II 

Part  II  of  the  report  has  dealt  with  the  development,  evaluation 

and  application  of  an  efficient  algorithm  for  studying  error  detecting 

codes  with  respect  to  use  on  renewal  channels. 

With  respect  to  the  algorithm  per  se,  it  is  efficient,  using  only 

tens  of  seconds  of  Univac  1108  CPU  time  on  the  average  to  compute  the 

figure  of  merit  for  evaluating  a polynomial,  even  for  the  largest 

collection  of  approximately  32,000  message  patterns. 

Even  though  the  number  of  patterns  for  which  probabilities  are 

computed  in  evaluating  2.'  is  a very  small  fraction  of  the  total 

number  of  undetectable  patterns,  there  is  good  evidence  that  Z P will 

8 

change  little  through  use  of  many  more  patterns.  This  evidence  is 

provided  by  data  on  ZT  P as  computed  with  more  and  more  message  patterns. 

g • 

The  most  extensive  study  of  convergence,  made  for  the  recommended 

polynomial,  shows  an  almost  negligible  change  in  Z P when  the  number 

8 

of  patterns  is  increased  from  24,000  to  32,000  for  all  ten  channel 
models . 

Additional  work  done  in  an  attempt  to  bound  probability  of  undetected 
error  and  thus  provide  a further  check  on  the  accuracy  of  the 
algorithm  did  not  give  useful  results.  Bounds  related  to  the  BCH  code 
were  considered  in  detail  in  this  part  of  the  study.  Generally  speaking, 
typical  bounds  are  too  loose  to  be  of  significant  value. 

A further  check  on  the  accuracy  of  the  algorithm  is  provided  by 
the  comparison  with  the  work  of  Johnson  [ 21 J who  estimates  probability 
of  undetected  error  using  a different,  although  related,  method. 


Agreement  between  the  results  of  Johnson  and  those  obtained  with  the 

2.  P 'algorithm  is  good. 

8 
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The  L P algorithm  has  been  used  to  rank  all  900  irreducible  16th 
g 

degree  polynomials  with  respect  to  the  Pareto  channel  model. 

For  32  check  bit  codes  with  block  lengths  of  2000  bits,  it  is  shown 

that  six  classes  of  BCH-Fire  codes  encompass  many  of  the  commonly  used 

types  of  codes.  Three  of  these  classes  are  investigated  in  detail  in 

a study  that  considered  a total  ~f  approximately  350  polynomials.  There 

is  no  evidence  to  indicate  that  dirferent  results  would  be  obtained 

from  a study  of  the  other  three  classes  of  BCH-Fire  codes. 

From  this  study  it  can  be  concluded  that  a group  of  possibly  a 

dozen  codes  will  provide  the  lowest  undetectable  error  probability  in 

general  applications  for  which  a precise  channel  model  cannot  be  specified. 

The  estimated  probability  of  undetected  errors  for  these  "good"  codes 

-12 

is  on  the  order  of  10  , a value  which  would  produce  one  undetected  error 

in  something  like  fifty  years  at  bit  rates  of  10  bits/seccnd.  Four 

polynomials  were  found  to  have  undetected  error  probabilities  as  large 

as  four  or  more  orders  of  magnitude  greate-  than  those  for  good  polynomials. 

The  code  polynomial,  X32+  X26+  X?3+  X22  + X16+  Xi2+  XU+  X10+  X8  + 

7 5 4 2 

X + X + X + X + X 1 , is  recommended  as  a specific  choice.  The 
characteristics  of  this  polynomial  are  investigated  in  detail  and  it  is 
shown  that  the  polynomial  has  a probability  of  undetected  error  no  larger 
than  on  the  order  of  three  times  that  of  the  best  polynomial  tailored 
to  each  specific  channel  model.  Fo*-  four  of  the  channel  models  considered 


this  polynomial  is  tnc  best  of  those  considered. 


PART  III 


GENERALIZATIONS 


1.  [Tie  Chien-t1  addad  Renewal  Model:  Results  for  a Special  Case 

The  work  repo:-(^d  Part  II  of  this  report  all  uses  renewal  channel 
models  which  depend  on  first  order  gap  statistics  and  hence  are  straight- 
forward to  identify.  As  discussed  above,  renewal  models  have  been 
matched  to  a variety  of  practical  chanrels;  however,  it  is  clear  that  not 
1 channels  can  be  modeled  as  renewal  channels.  The  Chien-Haddad 
1 is  one  of  rhe  most  general  nonrenewal  model  which  has  been 
considered  in  the  literature. 


i^ei 


Hevause  cf  the  complexity  cf  nonrenewal  models.,  such  as  the 
Chien-Haddad,  the  properties  of  such  models  are  less  clearly  understood 
than  the  properties  of  renewal  models  and  furthermore  there  is  less 
agreement  as  to  appropriate  choices  of  parameter?  to  match  practical 
channels.  As  a part  of  the  present  study,  two  Chien-Haddad  models  were 
investigated  and  the  results  are  compared  to  corresponding  results  for 
renewal  models. 

For  simplicity  a Chien-Haddad  model  using  two  by  two  matrices  was 
assumed  (corresponding  to  four  elementary  states).  Reference  to  the 
discussion  of  the  Chien-Haddad  model  in  Part  I indicates  that  to  define 
such  a model  requires  specification  of  , tt?,  q.,  q9  and  a 2 x 2 matrix 
Since  typical  parameter  values  were  not  available,  a somewhat 
arbitrary  choice  was  made  for  the  first  model  as  noted  below: 
Chien-Haddad  Model  15 


= 0.57143,  0.42857 

q - 10'5,  0.3 

4-  J 

o.;  o.3 

" i_  0.4  0.6  J ' 
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For  this  model  P(m,n)  was  computed  through  use  of  (1.62)  and  (1.63) 

and  the  resulting  curves  are  given  in  Figures  A. 21  and  A. 22  of  Appendix  I. 

In  order  to  compare  the  Chien-Haddad  model  to  the  renewal  models 
studied,  undetectable  error  patterns  of  small  weight  and  length  for 
several  particular  codes  were  determined  and  the  probability  of  these 
patterns  were  determined  for  the  Chien-Haddad  model.  (In  the  calculation 
it  was  necessary  to  use  (1.55),  which  gives  F(m  + 1)  for  the  Chien-Haddad 
mode  1 . ) 

For  the  parameters  chosen  for  the  Chien-Haddad  model  A the  probability 
of  typical  error  patterns  was  smaller  by  17  orders  of  magnitude  than 
corresponding  probabilities  for  Pareto,  Fritchman,  or  Tsai  models. 

A model,  termed  Chien-Haddad  Model  B was  constructed  by  adjusting  the 
parameters  so  that  typical  error  patterns  for  a fixed  code  had  probabilities 
on  the  same  order  of  magnitude  as  those  for  the  renewal  models.  This 
resulted  in  the  model  specified  below: 

Chien-Haddad  Model  A 

rt  = 0.985,  0.015  . 

u -i 

q = JO'5,  0. 3 J 

0.999  0.001  ' 

T u0. 066667  0. 93333 J 

Curves  of  P(m,  n)  for  Chien-Haddad  model  B are  given  in  Figure  A. 23  and 
A. 2-  cf  Append ix  1. 

Table  3.1  compares  the  total  probability  of  a collection  of  error 
patterns  for  several  16th  degree  generating  polynomials  for  the  Chien- 
Haddad,  the  Pareto,  the  Fritchman,  and  the  Tsai  models.  In  each  case  the 
collection  of  undetectable  error  patterns  is  comrv-al  te  to  that  used  by 
Johnson  .21.,  and  to  that  resulting  from  = = 5.8  x ln  5 in  the  method 
discussed  in  Part  il  of  the  report. 
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The  prohabi 11 t ios  of  typical  undetectable  error  patterns  for  the 
generator  polynomial  (Octal)  176053  were  compared  for  the  Pareto  and 
the  Chien-Haddad  model  B.  It  was  observed  that  the  probabilities  of 
individual  patterns  did  not  correspond  closely  for  the  two  models. 

For  example  for  the  group  of  patterns  examined  the  largest  probability 
using  the  Pareto  model  was  a pattern  of  length  42  and  weight  4 while 
the  largest  probability  using  the  Chien-Haddad  model  B occurred  for  a 
pattern  of  weight  6 and  length  23.  A similar  discrepancy  was  found  for 
the  smallest  probability  pattern. 

The  sensitivity  of  the  Chien-Haddad  nodel  to  a parameter  in  the  T 
matrix  was  investigated  by  determining  3(b,  N)/B(C,  N,  as  a function  of 
p for  the  model  specified  below: 

P 0.0001  " 

17  " L P + 0.0001  * p + 0.0001  J 

q = L0.001  , 0. 30 J 

= 0.9999  0.0001 

L P 1 - P -* 

The  results  given  in  Figure  A. 25  show  an  extreme  sensitivity  to  p. 

Choices  of  p on  the  order  of  0.1  would  seem  to  correspond  to  practical 
channels  which  would  not  seem  to  strongly  favor  bursts  of  a particular 
length . 

2.  Approaches  to  Developing  Channel  Models  Based  on  Physical  Parameters. 

As  noted  in  the  literature  review  of  Part  I,  most  existing  channel 
models  used  in  evaluating  codes  were  developed  by  matching  certain 
statistical  properties  of  binary  random  sequences  generated  by  some 
class  ot  mathematical  models  to  those  of  experimentally  measured  error 
sequences.  This  approach  does  not  place  in  evidence  the  effect  on  the 
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mathematical  model  of  charging  physical  parameters  such  as  signal-to- 
noise  ratio  or  intersymbol  interference,  nor  does  it  account  directly 
for  different  types  of  modems. 

The  literature  contains  a variety  of  analog  channel  models,  on  the 
other  hand,  which  are  parameterized  with  physical  variables.  These 
models,  however,  have  not  been  used  with  particular  modem  types  to 
compute  the  statistics  of  digital  error  sequences. 

In  principle  it  is  feasible  to  combine  analog  channel  models  with 
models  of  typical  modems  and  then  compute  the  statistics  of  appropriate 
digital  error  sequences.  Such  an  approach  gives  the  statistical 
representation  for  error  sequences  necessary  for  designing  codes  and  also 
retains  the  parameterization  in  terms  of  physical  parameters. 

A step  in  this  direction  is  taken  in  the  present  studv  by  considering 
a very  tractable  channel/modem  model  for  a binary  differential  phase 
shift  keying  system.  An  analysis  of  such  a model  by  Salz  and  Saltzberg  _ 30 J 
is  used  as  a starting  point. 

I h c-  system  considered  uses  a modem  modeled  as  consisting  of  a transmit  ter 
which  generates  an  ideal  waveform  and  a receiver  consisting  of  an  ideal 
input  and  output  filter,  an  ideal  delay,  a sampler,  and  an  optimum 
decision  rule.  The  channel  is  represented  simply  as  adding  Gaussian 
noise  which  is  statistically  independent  of  the  message  process. 

Although  trie  channel/modem  models  have  no  memory,  use  of  the  differentially 
coherent  cetector  introduces  a mechanism  for  memory  over  one  past  hit 
and  thus  the  system  has  a reasonable  probability  of  double  error. 

9-alz  and  °al,zberg  derive  expressions,  (equations  (19)  and  (21), 
p.  204  o!  30.),  for  tne  probability,  P(l,  1),  of  double  errors  and 
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the  conditional  probability,  P(l|l),  of  an  error  given  that  an  error 
has  occurred.  The  results  are 


P(l,l)  = ~ e 11  . {[1  - erf  (vM  cos  9)]2 

4rT  •'o 


+ ./Mr  cos  S e^ C [1  - erf  (^M  cos  6)j^ 


where 


[1  + erf  (,/M  cos  S)j}  d6 


Pd'i)  = = 2 e‘M  p(x»  D 


M = l/2o~  ~ signal-to-noise  ratio 


P( 1)  = \ e"M 


(3.1) 

(3.2) 


erf  (x)  = 


J 


X -t2 

e dt . 


,/rT  v 0 

The  expression  for  P(l,  1)  can  be  evaluated  numerically  for  u given 
valte  of  M.  Note  that  the  assumptions  of  the  model  limit  the  memory  to 
one  past  bit  so  that,  for  example,  P(l]l,l)  = P(l'l). 

lo  study  codes,  it  is  desirable  to  evaluate  the  statistics  of  an 
error  sequence.  It  will  be  shown,  first,  that  the  model  specifies 
a renewal  process,  which  is  completely  described  by  the  gap  probability, 
p(n),  and  the  probability,  P(l),  of  an  error.  The  gap  probability, 
p(n),  will  then  be  obtained. 

For  a renewal  process  the  gap  lengths  are  independent.  Thus  if 
P(g1 , ••*>  8^)  is  the  probability  of  successive  gaps  of  length 

g^,  g2>  ••••  Sk>  f°r  a renewal  process 


89 > •••*  8j^)  ~ p(Sj)  P(gk) 


t 5.3) 
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Consider  the  joint  probability  of  two  gaps,  P(g^>  S2^ » w^ich  can  be 
expressed  as 

81  “ ^ 8o"^ 

P(gL>  82)  = P(0  10  1|1)  (3.4) 

using  the  notation  of  Part  II.  Using  the  well  known  relations  for 

conditional  probability  the  following  equalities  result 

Si  "1  So”!  8i“ 1 So“^- 

P(0  10  4 1 1l)  = P(10  10^  1)/P(1) 

p - 1 

^ p/in  ^ i \ 8i 

= P(0  Z 1|10  1)  = P(0  L 1(10  1)  P(0  1 111). 

P(l) 

So-1  Si-^- 

Using  the  fact  that  P(0  1 * 10  1)  = P(0  1 J 1 ) , and  the  definicon 

of  p(g)  results  finally  in  the  equation 


PCgp  s2)  = PCg^  p(s2)> 


(3.5) 


R 


which  shows  that  the  model  is  a renewal  process. 

Further  manipw nation  based  on  relations  for  conditional  probability 
and  the  fact  that  memory  extends  only  over  one  past  bit  yields  an 
expression  for  p(n),  namely 


p(n)  = ^_ujLLPiq..-0).]r!"2 

rp(0)]n_1  P(l) 


(3.6) 


The  gap  probability  can  be  determined  from  the  relations  for  P(l)  and 
P(l,  1)  using  -.he  following  Identities 


i 


i 


P(l,  0)  = P(0,  1)  = P(l)  - P(l,  1) 


P(0,  0)  - F(0)  - P(0,  1) 


81 


(3.7) 


(3.8) 


ft 


Curves  of  p(n)  versus  n for  various  signal- to-noise  ratios  vere 
computed  and  the  results  are  given  ir  .'igure  3.1.  The  figure  also  gives 
the  p(n)  curves  for  several  of  the  Brayer  models.  Note  that  the  8 db 
signal- tc-noise  ratio  curve  for  the  double  error  model  very  closely 
matches  the  Brayer  Table  8 model.  The  data  also  suggests  that  several 
other  Brayer  models  could  be  matched  with  appropriate  signal  - to-noise 
ratios . 

3.  Approaches  to  the  Approximation  of  Nonrenewal  Models  with  Renewal  Models 
The  tractable  algorithm  for  estimating  the  probability  of  undetectable 
error  for  specific  codes  is  developed  in  Part  II  for  renewal  channels. 

There  is  a reasonable  expectation  that  a similar,  more  complicated, 
algorithm  can  be  developed  for  nor*.:  general  nonrenewal  channel  models. 

An  alternate  approach  to  studying  codes  for  nonrenewal  channels, 
which  is  worth  exploring,  is  to  approximate  the  nonrenewal  channel 
model  with  a renewal  model  which  is  equivalent  in  some  sense.  This 
section  of  the  report  suggests  an  approach  which  might  be  used. 

A class  of  Markov  processes,  termed  "unifilar  Markov  processes," 
which  have  useful  approximation  properties  are  defined  and  discussed  in 
the  literature  of  information  theory,  see  for  example  Ash  ^30^.  A 
Markov  Chain  is  said  to  be  unifilar  with  respect  to  the  function  P if 
for  each  state  C,  the  s cates  C,  . , C,„,  ...  which  can  be  reached  in 

K.  K 1 KZ 

one  step  from  C,  are  such  that  are  distinct  values. 

A subset  of  unifilar  processes  can  be  constrained  to  be  renewal 
pr>  -esses,  although  the  details  of  the  necessary  constraints  have  not  been 
worked  out.  Ir  ..sing  the  unifiliar  process  to  represent  the  error 
properties  of  a channel,  the  function  P(C^)  would  be  set  equal  io  0 
(no  error)  for  some  states  and  1 (error)  for  other  states. 


82 


Unifiliar  processes  have  the  useful  property  that  they  can  be  used 
to  approximate  any  other  given  Markov  process  of  finite  order  in  the 
sense  of  matching  the  "uncertainty"  of  the  process  arbitrarily  closelv. 

The  uncertainty  H(x)  of  a process  ivx^}  is  defined  as 

H(x)  = lim  H(xnjx^,  x£,  ...  x (3.9) 

n— 00  i ■ j.  - 1 

where  H(x  'x, , x„ . ...  x . ) is  the  conditional  uncertainty,  or  conditional 
n 1 2'  n-1 

entropy,  of  the  sequence  {x^,  •••  xnJ>  (see  Ash  [30j,  for  example,  for 
a definition  of  entropy). 

The  attractiveness  of  using  entropy  in  generating  an  approximation 
is  supported  by  two  observations,  namely: 

1.  If  the  function,  H(x  lx. , xOJ  ...  x .),  is  the  same  for 

n 1 2 ’ n-1 

two  processes,  then  the  nth  order  statistics  of  the  processes 
are  the  same,  and 

2.  Tile  capacity  of  the  channel  is  closely  related  to  the  entropy 
of  the  error  sequence.  Channel  capacity  is  a natural  parameter 
to  use  in  describing  a communication  channel. 

The  order  of  a unifilar  Markov  process  is  defined  as  the  minimum 
number  of  past  values  required  to  specify  the  current  value  in  the 
sequence.  Thus  the  order  of  a unifilar  process  required  to 

approximate  a process  within  an  uncertainty  error,  € , can  be 

determined  by  requiring  that 
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Details  of  matching  nonrenewal  processes  with  renewal  unifilar 
process  have  not  yet  been  worked  out.  Consideration  of  a simple  example 
seems  to  indicate  that  the  method  is  feasible,  although  a large  number  of 
states  may  be  required  of  the  unifilar  process. 

4.  Conclusions  for  Part  III 

Studies  with  a simple  Chien-Haddad  channel  model  have  shown  chat 
this  model  is  quite  sensitive  to  its  parameter  values.  Relatively  small 
changes  have  a pronounced  effect  on  burst  error  probabilities  and  hence 
on  the  probability  of  undetectable  error  sequences  for  codes,  if  this 
model  is  used. 

It  is  possible  to  adjust  the  parameters  of  the  Chien-Haddad  model 
investigated  to  give  sequence  probabilities  on  the  same  order  of 
magnitude  as  those  for  oJier  (renewal)  models.  If  this  is  done,  computation 
of  the  procability  of  a selection  of  undetectable  error  sequences  shows 
that  sequence  probabilities  can  be  quite  different  for  the  Chien-Haddad 
model  from  other  models  studied. 

The  work  in  Part  III,  Section  2,  shows  that  it  is  possible,  in  a 
tractable  case,  to  combine  analog  channel  models  with  modem  models  and 
compute  the  statistics  of  error  sequences  for  binary  operation.  It 
turned  out  that  the  simple  L'PSK  system  studied  gives  a renewal  process 
for  the  error  sequence  which,  for  certain  signal-to-noise  ratios, 
closely  matches  that  of  several  empirical  models  studied  in  Part  IT. 

The  comments  in  the  final  section  of  Part  III  outline  an  approach 
to  approximating  nonrenewal  models  with  renewal  models.  The  method 
seems  feasible  but  has  yet  to  be  evaluated  in  other  than  a trivially 
simple  case. 
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5 . Ri- commend;!  t Ions  for  Future  Work 


Ilie  work  undertaken  in  the  present  study  might  be  regarded  as  a 
first  step  in  the  general  problem  of  choosing  and  evaluating  error 
detecting  (and  possibly  also  error  correcting)  codes  for  large  scale 
networks . 

An  attempt  was  made  in  the  present  study  to  identify  problems  that 
are  of  significant  importance  yet  at  the  same  time  could  be  solved  in 
a reasonable  length  of  time.  This  led  to  the  concentration  on  renewal 
channel  models  which  are  both  tractable  and  represent  a major  fraction 
of  the  useful  channels.  Since  code  selection  is  based  on  channel  models, 
almost  exclusive  emphasis  in  the  study  was  given  to  techniques  for 
selecting  codes  for  renewal  channels. 

Future  work  should  be  directed  toward  a study  of  more  general 
channel  models  such  as  the  Chien-Haddad  and  to  code  selection  procedures 
for  these  models.  In  dealing  with  practical  systems,  especially  if 
degraded  operation  is  to  be  considered,  it  would  be  very  desirable  to 
have  channel  models  in  terms  of  measurable  physical  quantities  such  as 
signal- to-noise  ratio.  Future  work  is  also  required  in  this  area. 

Work  with,  and  related  to,  the  use  of  empirical  data  in  code 

selection  is  also  desirable.  First  of  all,  the  question  of  a sufficient 

collection  of  statistics  to  completely  characterize  a channel  with 

respect  to  the  coding  problem  seems  n be  completely  open.  On  another 

aspect  of  the  problem,  because  the  probability  of  undetected  error  for 

-13 

practical  codes  is  so  small  (on  the  order  of  10  ),  "brute  force" 

processing  of  recorded  error  sequences  to  evaluate  codes  is  essentially 
o it  of  the  question.  Alternatives  to  the  brute  force  approach  need  to 
be  developed. 


«6 


Finally,  it  seems  likely  that  complete  communication  network  designs 
will  be  evaluated  to  some  extent  through  simulation.  The  Monte  Carlo 
approach  of  directly  processing  simulated  data  sequences  is  a natural 
method  to  use.  Such  an  approach,  however,  is  limited  by  the  same  small 
error  probabilities  that  plague  the  use  of  measured  data.  Some  alternative, 
such  as  conditioning  or  being  near  an  error  or  the  use  of  amplified 
error  rates,  must  be  perfected  in  order  to  be  able  to  simulate  systems 
under  typical  operating  conditions. 
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APPENDIX  I:  Typical  Channel  Characteristics 
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APPENDIX  II:  PROGRAM  MAINTENANCE  MANUAL 


SECTION  1.  GENERAL  DESCRIPTION 

1 . 1 Purpose  of  PMM 

The  object  for  writing  this  PMM  is  to  provide  the  maintenance 
programmer  personnel  with  the  information  necessary  to  effectively  maintain 
the  system. 

1.2  System  Application 

The  system  described  in  this  manual  consists  of  11  independent  program 
modules  which  are  written  for  the  evaluation  of  code  generating  polynomial-. 

Several  error  statistics  are  calculated  for  renewal  channels  to  help 
evaluate  the  polynomials. 

1 . 1?  Equipment  Environment 

These  11  program  modules  were  written  for  Univac  1108  Fortrain  V 
Compiler  and  have  been  modified  for  IBM  360  Compiler  H System. 

To  make  use  of  the  built-in  logic  functions,  like  LAND(a,b),  L0R(a,b), 
LX0R(a,b),  etc.,  an  additional  compiler  option  would  be  coded. 

PARM.  procstep  ~ ( XL,  ....) 

Here  XL  subparameter  is  not  positional. 

1.4  Conventions: 

1)  Integer  Variables  always  begins  with  I,  J,  K,  L,  M,  N 

2)  Abbreviation: 

U.D.  = Undetectable 

ERR.  = Error 

PROG.  = Program 

Prob.  = Probability 

Info.  Seq.  = Information  Sequence 
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SECTION  2.  SYSTEM  DESCRIPTION 


2.1  General  Description 

Each  of  the  11  program  modules  is  self-contained  and  can  be  compiled 
and  linked  to  form  independent  load  module. 

Each  program  module  contains  at  least  one  MAIN  program.  Some  modules 
may  contain  one  MAIN  program  and  other  subprograms. 

The  interaction  between  these  program  modules  and  the  datasets  is 
shown  in  Figure  1. 

2.2  Detailed  Description  for  Each  Module 

2.2.1  PROG.  MODULE  "Z" 

a)  Module  Tag  = Z 

b)  Given  1.  weight  of  error  burst 

2.  burst  size 

3.  code  generating  polynomial 

this  module  does  exhaustive  search  for  U.D.  ERR.  pattern, 
by  doing  polynomial  division, 
d)  See  comments  on  program  list. 

i)  Subprograms  ERPAT,  DIVISN  3nd  FLD  (J,  K,  MS,  NV,  NG,  KP) 
are  linked  in  this  module. 

For  ERPAT  and  DIVISN,  arguments  are  passed  from  MAIN  program 
through  COMMON  block. 

k)  Stop  execution,  when  I/O  error  occurs  on  card  reader. 

2.2.2  PROG.  MODULE  "A" 

a)  Module  Tag  = A 

b)  It  creates  and  catalogs  Dataset  F(3080),  P(3C72)  and  R(1?8.200) 

4 

for  PARETO  model  with  parameters  ET  = 3x10  , ^ = 0.3. 
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1 "1  - - Of  , - 

*F(n)  = Prob.  (0  II)  - 1 - ■ — — ' j j , n 2 1 

1 L l-La  J L na  J 


(ET  + 1 , l~a 


here  L = (ET  + 1 . 

L O'  J 


*P(n)  = Prbb.  (0  l|l)  = F(n)  - F(n+1) 
r 

F(n)  , n = 1,  n 2 1 
*R(m,n)  = / n'iiH-1 

| £ P(j)R(n»-l,  n-j),  2SmSn,  ns2 

J-l 


*PE  = individual  error  probability 


= il£ Z L«-l 

O' 

d)  See  commends  on  program  list. 

i)  Subprogram  Function  FX(NA,SL,ALP)  is  linked  with  MAIN, 
k)  Stop  execution  when  I/O  error  occurs  on  card  reader. 

2.2.3  PROG.  MODULE  "B" 

a)  Module  Tage  = B 

b)  This  module  calculates  the  U.D.  ERR  pattera*s  probability 

U 1 N_b+1 

Prob.  = n [F(d  ) - F(d  + 1)]  £ 2 F(d)F(N-b+2-d) 


W is  weight  of  burst 
N is  message  block  length 
Refer  to  comments  on  program  list 
d)  See  comments  on  program  list 

h)  Exit  when  card  reader  reaches  the  Delimieter  Statement  (/*'>, 
k)  Stop  execution  when  I/O  error  occurs  on  card  reader. 
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2.2. 4 PROG.  MODULE  11 C" 


y 


a) 

b) 


d) 

k) 


2.2.5 


a) 

b) 


d) 

h) 

k) 


Module  Tag  = C 

Creates  and  catalogs  Datasets  F,  P and  R for  Markov  models. 

*F(n+l)  = Prob.  (0n/l)  = 8 ^^kk)0’1 

K“  1 

*P (n)  = Prob.  (On_1l/l)  = F(n)  - F(n+1) 
f]F(n)  m = 1,  n s 1 


*R  (m , n ) 


= - 

n-nrt-1 

E P(j)R(m-l,n-j) 

j“l 


2 £ m £ n 


*PE( individual 


error 


N-l 

probability)  = 1 + E 
L K=1 


fcNK  l~l 
1_tKK-* 


N - number  of  states 

t„„  - entry  at  Nth  row  and  Kth  column  of  state- 
transition  matrix 
See  comments  on  program  list. 

Stop  execution  when  I/O  error  occures  on  card  reader. 

PROG.  ")DULS  "D" 

Module  Tag  = D 

Calculates  the  U.D.  ERR.  pattern  probability  for  Markov  models. 

\j  } N-b+1 

Prob.  - n rF(di)  - F(di+l)]jj  S F(d)  F(N-b+2-d) 
i=2U  N d=l 

W = weight  of  error  burst, 
di's  = gap  lc.’gth  of  the  pattern 
N = message  block  length 

Refer  to  comments  on  program  list. 

See  comments  cn  program  list. 

Exit  when  card  reader  reaches  the  Delimiter  Statement  (/A'). 

S.op  execution  when  I/O  error  occures  on  card  reader. 
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2.2.6  PROG.  MODULE  "K" 

a)  Module  Tag  = E 

b)  Calculates  P(m,n)  for  both  PARETO  and  MARKOV  models. 

n-rrH-1 

P(m,n)  = E PE«F(j) »R(m,n~ j+1)  lsmsn 

j“l 

PE(individual  error  prob.),  F(j)  and  R(x,y)  are  all 
created  ip  module  A or  C. 
d)  See  comments  on  program  list. 

h)  Exit  when  card  reader  reaches  the  Delimiter  Statement  (/*). 

2.2.7  PROG.  MODULE  11 F" 

a)  Module  Tag  = F 

b)  It  creates  and  catalogs  Dataset  A(j)  for  the  use  of  module  G. 
Applicable  to  both  Markov  and  Pareto  models. 


A(j)  - 


J»0 


F(l)  - F (2 ) j=l 


j-1 


[F(  j)  - F(  j+l)  J + E [F(s)  - F(s+l)]A(j-2)  jsl 


d)  See  comments  on  program  list. 
2.2.8  PROG.  MODULE  11 G" 


s«l 


a)  Module  Tag  = G 

b)  Calculate  (B(bsN)/N*PE)  for  Markov  and  Pareto  models. 


B(b,N I). 
N»PE 


A(b-l) 


N-b+1 

i E F(d)F(N-b+2-d) 
N d=l 


A(x)  is  autocorrelation  arrav  created  in  module  F. 
d)  See  comments  on  program  list. 

2.2.9  PROG.  MODULE  "H" 
a)  Module  Tag  - H 
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iurw..  *■  . . 


b)  Calculate  quantity  Sp(b,N) 


. N-b+1 

Sp(b,N)  = r T F(d)  F(N-b+2-d) 
d=l 


d)  See  commencs  on  program  list. 

Only  1 input  data  card,  it  contains  KB  (limit  of  b)  and  N(block 
length) . 

This  module  will  print  Sp(l,N)  to  Sp(KB,N). 


2.2.10  PROG.  MODULE  "I" 


a)  Module  Tag  = I 

b)  This  module  generates  most  probable  information  sequence  based 
on  Pareto  model's  gap  statistics  P(3072). 

The  info.  seq.  is  used  in  module  J to  evaluate  code  generating 


polynomials. 

The  info.  seq.  generated  is  stored  in  a 2 dimensional  array 
INFG(1000,2)  before  its  being  written  to  Dataset  INFSEO. 


The  Kth  info.  seq.  is  etored  as  follows: 

Assume  Kth  info.  seq.  is  100  0110  0 010  0 10  (weight  = 5) 


Integer  INF0(K,1) 


INFO (K, 2) 


j31  ! 


1-  W 10-1 1'  To  17'  '2223 


28.29  30.31 


Byte  & 


J Byte 
5 


Byte  Byte 
4 3 


Note:  Bit  0 is  not  used  to  construct  byte  6. 

Then  Byte  1=5=  weight 

Byte  2=2=  position  of  right  most  "1"  in  this  info.  seq. 
Byte  3=5=  position  of  2nd  right  "1"  in  this  info,  seq. 
Byte  4 = 9 = position  of  3rd  right.  "1"  in  this  info,  seq. 
Byte  5 = 10  = position  of  4th  right  "1"  in  this  info.  seq. 
Byte  6 = 14  *•  position  of  left  most  "1"  in  this  info.  seq. 
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Note:  For  weight  other  than  5,  the  byte  allocations  are  different 

from  above. 

d)  See  comments  on  program  list. 

i)  Subroutine  WRITER  (ICT,IT)  is  link.  ‘ with  MAIN  program  in  this 
module. 

2.2.11  PROG,  MODULE  11 J" 

a)  Module  Tag  = J 

b)  This  module  evaluates  polynomials  according  to  the  following 
steps: 

1)  Read  in  info.  seq.  (created  in  module  I)  and  P(3072)  dataset 
(created  in  Module  A or  C) 

2)  Read  in  a polynomial  G(x) 

If  a Delimiter  Statement  (/*)  is  read,  go  to  Step  6. 

3)  For  each  info,  seq.,  get  a U.D.  ERR.  pattern 
which  is  INF  • XK  + R(x). 

Here  INF  is  info.  seq. 

K is  degree  of  G(x) 

R(x)  is  the  remainder  of  (INF  • XK/G(x)) 

4)  Calculate  probabilities  of  U.D.  ERR.  patterns  obtained 
in  Step  3 and  sum  it  up  for  all  info.  seq. 

5)  Jump  back  to  Step  2 to  read  one  more  polynomial. 

6)  Arrange  the  polynomials  in  ascending  order  according  to  the 
total  U.D.  ERR.  probability  associated  with  it. 

7)  Print  the  polynomials  and  its  probability  in  ascending  order, 
d)  See  comments  on  program  list. 

h)  Exit  when  card  reader  reaches  /*  stat'-ment. 

i)  Subroutine  FLD(J,  K,  MS,  NV,  NG,  KP)  is  linked  with  MAIN  program, 
k)  Stop  execution  when  I/O  error  occures  on  card  reader. 
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SECTION  3.  INPUT/OUTPUT  DESCRIPTIONS 


3.1  General  Description 

This  system  uses  5 I/O  data  sets  — F,  P,  R,  A,  and  INFSEQ. 

These  datasets  can  be  created  or.  Tape  or  other  secondary  storage. 

The  reference  number  used  for  each  data  set  is  indicated  in  the 
comments  of  each  program. 

"-'Datasets  F,  9.  R and  A are  created  under  Format 
(5X,  5(E23.U,2X)) 

*Dataset  INFSEQ  is  created  without  format  control. 

SECTION  4.  PROGRAM  ASSEMBLING,  T, GAPING 

a)  To  obtain  lead  modules  for  each  program-tncdule  described 

in  Section  2,  please  refer  to 

"IBM  SYSTEM  360,  FORTRAN  (G&H)  PROGRAMER'S  GUIDE" 
GC28-6817-3  Page  83  . 

b)  To  specify  a dataset  for  a run,  please  refer  to  the  same  document 
as  above  pages  49  - 52. 

c)  The  test  runs  for  modules  Z,  B,  F,  C,  H,  I and  J are  described 
below 

Remark: 

*The  polynomials  shown  on  the  Uoivac  1108' s output  are  in 
Octal  representation.  For  IBM  360  polynomials  will  be  in 
Hexadecimal  representation. 

*b  = blank 

Assume  Datasets  F.  P.  R.  A for  Pareto  model  and  Brayer's  table 

6 model  are  already  created. 

1)  Module  Z. 

1st  input  card  = bb6bl5 

2nd  input  card  = OOOE04B 

= 160113  (Octal) 

3rd  input  card  = bl6b29 
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The  output  is  shown  on  page  A-l 

2)  Module  B 

1st  input  card  = b3200 
2nd  card  = bbbb4bbbb4bbb. . . . 

3rd  card  = bbbl8bbb47bbb61bb. . . 

4th  card  = bbb39bbb65bbb70bb. . . 

5th  card  = bbb68bbb71bbb90bb. . . 

6th  card  = bbb77bbb89bbb93bb. . . 

7th  card  = /* 

Output  is  shown  on  page  A- 2 

3)  Module  F 

Specify  Fareto  model’s  Dataset  F as  input  dataset  with 
reference  number  = 10. 

No  input  datacard. 

Part  of  the  output  is  shown  on  page  A- 3. 

4)  Module  G 

Specify  Pareto  Model's  Dataset  F and  A as  input  datasets 
with  reference  numbers  = 10,  11  respectively 
1st  input  data  card  = 2000bbb... 

Part  of  the  output  is  shown  on  page  A-4 

5)  Module  H 

Specify  Pareto  Model’s  Dataset  F as  input  dataset  with 
reference  number  = 10. 

1st  input  data  card  = bb452000bb.. 

The  output  is  shown  on  page  A -5 

6)  Module  I 

Specify  Pareto  model's  Dataset  P as  input  dataset  with 
reference  number  = 9 
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The  output  1b  shown  on  page  A-6. 


7)  Module  J 

Specify  Braver  Table  6 model's  Dataset  P and  INFSEQ 
(created  in  Module  I test  run)  as  input  dataset  with 
reference  numbers  = 9^8  respectively. 

1st  card  = 32bbb... 

2nd  card  = bbbbbbbl04CllDb7bbb. . . 

L=  4046 021666 7 (Octal)] 

3rd  card  = bbbbbbbl9262E7C59bbb. . . 

[=  62613476131  (Octal)] 

4th  card  = bbbbbbbl857D984Dbbb. . . 

O 60537314115  (Octal)] 

5th  card  = /* 

The  output  is  shown,  on  page  A- 7. 
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For  polynomial  = (0000E04B) - , = (160113)o>  Number  of  error  bits  = 6 

io  o 


burst  No.  of  TH£  FOUlOwImS  ERROR  3ATTERNS  ARr  UNDETECTABLE: 


size  error 

^ st 

bits 

EXPONENTS 

0=  mom 

l-ZE 

RO  TERMS 

{ 

16, 

6) 

( 

17, 

5) 

l 

19, 

6) 

( 

19, 

5) 

l 

20, 

&> 

( 

21, 

6 ) 

( 

22, 

5) 

( 

23, 

6) 

0 

9 

12 

15 

IB 

22 

( 

24, 

6) 

( 

25, 

5) 

( 

25, 

5) 

0 

3 

9 

?1 

22 

25 

0 

11 

13 

16 

18 

25 

( 

27, 

5) 

( 

28, 

6) 

( 

29, 

5) 

:S 

T I MAT 

ED' 

RUN 

time 

EXCEE 

R 

eent 

addrjoi 

2453 

bo'i: 

Q0n0n4 

X 

000000  000000 
A 1 77777  777771 

oooooo  ooooon 
oooooo  oooooo 


O°n00n  000007  OoOOOQ 
0°n00fi  OnOOOO  OOOOOO 

OOnOOn  134425  oooooo 
oOnOOn  OnOOOO  OoOOOO 

o°nOon  oooooo 


noonoo  OOOOOO  nOOnOo 

nOOOOO  000164  nl2l7ft 

071052  OOOOOO  n0007l 

noonoo  oooooo  noonoo 


R 

R JNSTrEAM 


OOnOOn  000002 

oooooo  ooooon  o°n00n  Onoooo 

ANALYSIS  TERMINATED 


777777  777776  0001&4  n445l6 

OOOOOO  nOOOOO  777777  77777s 


RUN10: 

seaso 

ac'ct:  0I1A01.34 

PROJECT:  MJRTHY' 

U1 

llj 

aSd  max 

TIME 

time: 

totau: 

00:01:00.723 

cpj: 

00:00:59.375 

i/d: 

00:011:01.395 

cc/er: 

00:00:00. 951 

rfAlT: 

oo:on:oo.ooo 

IMAGES 

read: 

7 pages: 

2 

start: 

22:34 

:i}9  JJl'  2«j»  19 74 

pin: 

22:35:25  JUL 

OOOOOO  0 
777777  7 

777777  7 
OOOOOO  O' 


COOOOO  0 

oooooo  0 
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& 


1 

l; 

V" 

St.' 

* •■  «lbUH3 

I’OLYiJOMIAL  o-a 

i 

1' 

N = 3200 

?- 

i 

ia  A v»  1 „,ul_6c.t..f‘ AW  | Oi^i 

i 

5^ 

- 

J 18  47 

ul 

% 

; 

r'!vj;i,.i3ILI  ry= 

,OOUOOOOU3U:v» 

j£- 

u 09  ob 

70 

f& 

CS 

••'iN^MOiLi  ry= 

• OOOUOOUU4<j  /4 

| 

g* 

0 oO  71 

90 

P 

r't'Ob^iJiLi  ry= 

.OOOOOUOUblbU 

1 

0 77  89 

90 

s 

^rswonOlLl  TY= 

.000000006709 

iS 

1 

0 10  18 

20  24 

6 

v 

fJrvOb„'->ILlTY= 

• pQ 000 0021692 

f 

0 10  20 

26  04 

5- 

P^UoAblLI i Y= 

.00000000147b 

j: 

U 6 15 

26  35 

i'l^OBrttjILl  TY  = 

.000000001155 

£ 

& 

u 10  2 a 

39  47 

1 

Hr.OoMdiLITY= 

.OUUOOOOOOoOO 

fe 

0 20  oo 

46  48 

£. 

bKOdAbILI IY= 

.000000000622 

It 

0 22  02 

44  49 

& 

8f- 

Hi\ObMt>IUTY= 

.000000000069 

1 

0 9 OU 

42  49 

hj'OOmOIli  ry= 

.000000000^97 

1 

0 13  14 

37  51 

;r 

pkoJmdili ry= 

.000000001184 

1 

0 8 18 

29  51 

1 

br<Cd«L>  ILl  T Y- 

.000000000230 

0 21  09 

40  53 

HKOo^d ILI TY- 

.000000000005 

2 

0 io  27 

40  53 

i-S 

ft 

it 

H.<OriMoILITY= 

.QU0000000152 

| 

0 00  00 

36  53 

1 

HivOSmo ILI  TY= 

.000000001^21 

| 

sj 

0 4 05 

53  55 

1 

Hr<ObMbILlTY= 

.000000001224 

i 

0 18  07 

55  60 

f 

! 

Hi\0UrtoILI  ry= 

.QOU 000000127 

£ 

0 8 Oo 

55  ol 

HnOoMbILX  rr= 

.000000000161 

& 

0 12  27 

08  61 

hi\0umoili  rr= 

.OOOOOOOOOU3U 

;j  oo  45 

57  63 

1 

HuOBrtdlLl 1 Y- 

.000000000120 

0 0 24 

41  oO 

1 

HKOJmuILI I Y= 

.00000000  fjl09 

1 

0 14  26 

45  64 

sc 

HnOd.,oiLi  ry= 

.00000000Q05O 

1 

0 b 11 

54  66 

% 

KKOo»L.iLl  f Y = 

.000000000072 

k 

U 10  15 

50  6b 

jif 

HrvOj.«d  ILI  T Y- 

. 00 000 000. ■) lob 

| 

•J  9 12 

15  J 8 22 

1 

j >, \u  i L 1 f Y ~ 

• ■)  ‘j  O U 0 0 O 0 1 v 7 0 

1 

J 0 9 

21  22  25 

* 

tit 

n = 

. OUOUOlf  0U2ooJ 

ii 

.J  il  10 

1 n 16  2b 

| 

t <'  i j,*  ati  n = 

. '10 v1 0 0000  < 'iZ  l 

* ** * * t 


^ — 


These  4 patterns  are  tested 


<- 
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Copy  oviajahta  in  DOC  dotm  no! 
ponait  JuBy  logibio  i ©product!  ot. 


♦ ACa-i)  ^A^iio  oisnmjtijn  — si 

rssoooo 

\ s.  *V  »/~0  ^04 

1 0Ul0o3 

001210 

2 

040012 

.140054 

1 

1 001211 

001233 

xC  .VT  x/FONuH 

1 001234 

001455 

2 

U400b5 

.*40161 

\ »-t»f>  ■./- o-< 

2 

0401»2 

IW2J&3 

. /- 0 ^/‘-E 

1 00l4b6 

001723 

2 

0423f>4 

i,4?4ln 

\ <Vr  09o9-A 

t 001724 

002003 

2 

042411 

0424? 4 

rc  \/-0^59 

1 0020U4 

002030 

0*53 

1 002031 

0021.42 

\ ,j3L i/r035ii 

1 002143 

002203 

1 UU22U4 

002237 

^ j-<!/F0*j3 

1 002240 

002262 

\iji  iM'/ro^SB 

1 0U22b3 

002557 

2 

042425 

l»4?43o 

Vj jT$/? 0959 

l 002560 

003734 

2 

042431 

,142467 

\*  -.T  t>/r  39^9 

1 003735 

004611 

2 

042470 

U42544 

t 0046i2 

005014 

2 

042545 

042703 

i/r 0459— 3 

1 0050X5 

006002 

2 

042704 

043057 

4 

043060 

043131 

>,  1 *t-)  *-/r09 

2 

043132 

043170 

£ •?  J J»/ SYS59-3 

’j..i"5/F09o9-A 

1 005003 

006211 

2 

043171 

643210 

Nl£*S/F0*69-A 

1 006212 

006373 

2 

043211 

043330 

\ijjJ-7*/-0*b3 

1 006374 

006434 

Ni*‘J5?i/r  0*b8 

1 006435 

006631 

2 

043331 

04340? 

*lav,D\J:T0q/^F0Rb9-5 

1 005632 

010351 

2 

043403 

044350 

VAX'! 

1 010352 

010560 

0 

044351 

1)50326 

1 010561 

010632 

0 

050327 

050342 

SrjS*qLl3i.  LEVEL  69-5 
£ M j 3v.A?:  U.530  SECONDS*  Oil  6L0C<5 
A(0)  -1,0000 
A(l)  - .1993'4 
A(2)  -.12965 
A(3)  - .10223 
A(6)-5. 59553-02 
A(5)-7. 49254-02 
A (6)  •£>•  .63555-02 
A<7)-6. 06754-02 
A(8)-5. 57424-02 
A(9)-5.  17021-02 
A(10)-u,  53205-02 
A(ll)-4, 54412-02 
A(12)-4.  29543-02 
A(13)-4, 07304-02 
A(14)-j..,y5il-02 
A(15)-3.715l5-02 
A(16)-3,  55176-02 
A(17)-*#  1,2319-02 

A (18) -3, 2972^-02 
A<19>"3.  1^225-02 
A(20)-3,n7£,72-02 
A(2D-2. 77945-02 
A(22)-2.  (M44V-U2 
A(23)-e,  .,j597-02 
A(24)-?,  /2319-U2 
A(25)->. 

A(26) - - , ,ri753-u?. 

A (27)  - ■ . >*,-,! 
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♦ ••i 

Pair*  to  Modal 

, <-:#M  CALCULATIONS*  * **♦  * 

at 

*S»20JU)s 

• 0C04305i*b('>992<»7 

*< 

2o»20jO)= 

• CC046  7**65;j71572 

at 

2V»20.)0)  = 

.C00455nC1573776 

D< 

s!J»20  jO)  = 

.000444275337941 

at 

29*20-."))  = 

• CCO43  3**1 6973169 

3t 

3o » 20  *0 ) = 

.C00423*i65o30626 

*< 

il»20u&)= 

.000414367375631 

*< 

i2»20i0)  = 

.000405076156312 

at 

d3*20j0)  = 

. 000396549268771 

34*  20 ' * 0 ) = 

• CO 03tid4u921 4 370 

S( 

35*20  jO  ) = 

• C 00380743207643 

at 

36»20.*0)  = 

•G00373 4 Q1653633 

at 

37*20ju)= 

•G0036o397383914 

at 

3d * 20  JO)  = 

..  003359  70631  50b6 

at 

39 i 2000)= 

.000353306384790 

B( 

40*2000)= 

.000347179124219 

a< 

4 1 * 2 0 J 0 ) = 

. 000341304847097 

a< 

42»20J0)= 

.000335867831678 

at 

43»20j0)= 

.000330253489665 

B( 

44*20ju)= 

.000325047432352 

at 

45»20J0)= 

« 000320037336700 

46»20-j0)  = 

.000315212004352 

at 

47#20J0)= 

.000310560586513 

at 

43  * 20  JO ) = 

.000306073259708 

at 

49*  20i'0 ) = 

.000301740619761 

8 f 

50  # 20jO ) = 

.000297554768622 

3< 

SI *2000)= 

.0002935C7951893 

a t 

52*2000)= 

• CGC289591 993351 

8( 

03*20)0 ) = 

.C002853C1S48804 

at 

S4*20 )0)r 

.000282129785774 

3< 

05*  20  jO ) = 

.000278570831142 

B ( 

56*  20 JO ) = 

.000275118325812 

9t 

57*20  )0)  = 

.000271769349638 

8f 

53*20  jO)  = 

.000268517331279 

B( 

S9*20j0)= 

.000265358670731 

8t 

O(J»20;0)  = 

.000262286322) 19 

a t 

6i*20u0)= 

.000259303 3? C490 

8 1 

52  f 20 jO ) = 

.000256399413C47 

9 i 

63*20  ;0)  = 

•0002535732G9193 

a t 

o4*2000)= 

•000250621311056 

at 

65*20 jO>= 

• 000248141 1C6567 

at 

oo»20'j0  ) = 

• CCO 24 552 9197355 

at 

a 7*  20-10  ) = 

.000242983074713 

at 

86*2090)= 

•000240499965003 

.000238077504036 

at 

o9*2000)= 

at 

70*20 jU>= 

.000235713532675 

at 

7l*20j0)= 

.000233405216932 

at 

72*2000)= 

.000231151303961 

a t 

73*2090)= 

.000228949060329 

M 

7 4 * 20u0)  = 

. 00C22579689G274 

•- 1 

75*2000)= 

. 0002246934 80050 

- 1 

7«*2000 ) = 

.000222636144627 

" t 

77*2000)= 

. 0002296240424 13 

at 

73*  20  jO ) = 

» 0 0 02 1 06554 638 64 

-»t 

79  * 2 0 0 0 ) = 

• C09216726uc4£ftQ 

» » 

00*20.0)= 

. OGO?  14 -*421?  0067 

•>t 

il*20  50)  = 

• 009212  1?49t-.529t 
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Obey  ondtab I#  to  DDC  down** 
pmrit  hiflf  bfliM*  »P~du‘,i00 


Caret o Modal  .Hp(X,  2000) 


A/r 

s/T'V* 

i* 

* > 

• 4 

•'r 

Ki  06  / . J 

. s iWi  roi*/.. ‘—•i 


rrr.'.Tpvr: 


|.*.  / /,j  » !.< , |7  /4  i 
-*7  ••  1 1*1 


II  I 1 c 1 > I 0 1 6.7 

i*  1 1 .» f 4 | 1 70^ 
»l!*/ui  OTS.iOo" 


✓ 


Cf 


'!  rr.*\  i r ,*’l 


•-i 


<? 


fW  «,  .»>. 

l»  • . ♦ 

> ■ S -t  '...- 

r;i  i.  . 

* * t rr-;.i 

V • 

1 t >-  li  l \t  ) 

i oir>vi  i ?>— o i 

S'M 

t’  * •*■*»»»  i»  J 

. 47  /2r,Sp'v39o0393-(l  J 

Sp< 

3 »•'.<)'•  >)  t 

- 

Set 

'* i .-ii 4;, ) 

r 

• *'■.  / o -1 33^, ) ?j2 j4nAi#—(j  j 

'V<' 

Si  l|'u  1 

' r 

. 4 ? .;  7 7>'  7 7 ITS  sU/i  ^T'  * 

ser 

III  ivl 

- 

• 4 i ij  jr* l n6.t5  /3[i£?i»~n  1 

S^< 

( i - i •''In  ) 

.4/.j4,V 

S'Jt 

Ki..urtn  ) 

- 

.i.7o  144439^-01 

5P( 

• 

• ;>  / (f\j  Q76u-n  l 

set 

1 !lfP.,.'i.) 

.•>7.,1  Iu34l4o4f,4  7-0l 

sre 

1 l » u > 

- 

. 47j'?74.;39^i  i^b  l -f)  1 

SPr 

| 2 i c 1,'lti  ) 

.47.jtti|UlfS4oSS4l-0L 

set 

l -i  • £ U ’■)  l.  * 

.4/uVy4749iuio7i,-ol 

set 

l 4 > ^tiC.i  ) 

- 

.67^5^746793 131 m-01 

set 

1 UrKoOut 

- 

. 67o 430s  306d220n-0r~ 

set 

| 6 » d.  u 0 u J 

“ 

.47^293^4646696-1-01 

Sp< 

1 7»  i,|Ru  1 

. 67.j  f5  61104  726067-01 

>Spt 

1 >3 1 tijOu  J 

- 

.67d01Bs50028P9w-01 

«SJ< 

1 l>  1 <-  I#  0 (j  ) 
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CALCULATION  FOR  s5n«;-lR-?£DUClflLE 


G(X)  PROti ( 1 1 • L • ) 


2nd  card  ^ 
2 

4th  card  3 
3r<rrHrd--4 
‘5 
6 
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These  3 polynomials  are 
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APPENDIX  III:  A NOTE  ON  THE  MUNTEK-WOLF  CHANNEL  MODEL 


Cars  should  be  exercised  in  applying  the  particular  case  of  the 

Munter  and  Wolf  model  discussed  on  pages  27  and  28  due  to  the  following 

inconsistency:  Combining  (1.69)  and  (1.71)  one  has 

/n\  mi-1  __n+l  ...  n-m 

^m  ) Kj_  (l-a'P 


Noting  that 


M 


P(m,n)  = Z A^d) 


i=l 


[1  - K.(l  - a.)]' 


\ 


Z P(m,n)  = 1 , 
m=0 


as  a fundamental  property  of  P(m,n),  implies  that 


Slp.(1) 

i 1 1 


a.  Kf1 

— Z " 1 

[1-K.a-a.)] 


for  all  n.  Hence,  = 1 and,  therefore, 


EX.  P.(i)/a.  = l. 
i 

Since  Z L = 1 and  from  the  assumption  P^(l)  < < , it  is  clear 

i 

that  Z A.  P.(l)/a.  < < 1.  Hence,  a contradiction  in  the  model, 
i 1 1 1 
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